[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:14 dist-test-slave-gkw7 krb5kdc[27394](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:15 dist-test-slave-gkw7 krb5kdc[27394](info): set up 2 sockets
Aug 06 02:17:15 dist-test-slave-gkw7 krb5kdc[27394](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 02:17:16.146023 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.006s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:16 dist-test-slave-gkw7 krb5kdc[27394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:17:16.283339 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:36171
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:36171
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:16.444526 27413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:16.444885 27413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:16.444988 27413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:16.449366 27413 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:16.449481 27413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:16.449520 27413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:16.449575 27413 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:16.449612 27413 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:16.455405 27413 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:36171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:36171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:16.456943 27413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:16.458525 27413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:16.472977 27419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:16.473918 27423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:16.474000 27421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:16.474936 27413 server_base.cc:1034] running on GCE node
I20260806 02:17:16.475700 27413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:16.477443 27413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:16.478631 27413 hybrid_clock.cc:648] HybridClock initialized: now 1785982636478606 us; error 39 us; skew 500 ppm
Aug 06 02:17:16 dist-test-slave-gkw7 krb5kdc[27394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982636, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:16.482358 27413 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:17:16.483681 27413 webserver.cc:460] Webserver started at http://127.26.189.190:35385/ using document root <none> and password file <none>
I20260806 02:17:16.484647 27413 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:16.484760 27413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:16.485186 27413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:16.488085 27413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "7477ef7aa1e846858e7637faefce0940"
format_stamp: "Formatted at 2026-08-06 02:17:16 on dist-test-slave-gkw7"
server_key: "2df11a67b0192fc8d072a0b32137f7ab"
server_key_iv: "28fe433c10ca749d17dffc861a061228"
server_key_version: "encryptionkey@0"
I20260806 02:17:16.488993 27413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "7477ef7aa1e846858e7637faefce0940"
format_stamp: "Formatted at 2026-08-06 02:17:16 on dist-test-slave-gkw7"
server_key: "2df11a67b0192fc8d072a0b32137f7ab"
server_key_iv: "28fe433c10ca749d17dffc861a061228"
server_key_version: "encryptionkey@0"
I20260806 02:17:16.494587 27413 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 02:17:16.498479 27431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:16.500561 27413 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:16.500789 27413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "7477ef7aa1e846858e7637faefce0940"
format_stamp: "Formatted at 2026-08-06 02:17:16 on dist-test-slave-gkw7"
server_key: "2df11a67b0192fc8d072a0b32137f7ab"
server_key_iv: "28fe433c10ca749d17dffc861a061228"
server_key_version: "encryptionkey@0"
I20260806 02:17:16.500934 27413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:16.522308 27413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:16.526484 27413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:16.526803 27413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:16.542297 27413 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:36171
I20260806 02:17:16.542420 27499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:36171 every 8 connection(s)
I20260806 02:17:16.543781 27413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:16.545030 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 27413
I20260806 02:17:16.545217 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:16.546913 27382 external_mini_cluster.cc:1428] Setting key 07db304d9a3305e2fa588a990b1ddd81
I20260806 02:17:16.549443 27502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:16.561197 27502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940: Bootstrap starting.
I20260806 02:17:16.565696 27502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:16.567217 27502 log.cc:824] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:16.570957 27502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940: No bootstrap required, opened a new log
Aug 06 02:17:16 dist-test-slave-gkw7 krb5kdc[27394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:16.576321 27502 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7477ef7aa1e846858e7637faefce0940" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36171 } }
I20260806 02:17:16.576779 27502 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:16.576889 27502 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7477ef7aa1e846858e7637faefce0940, State: Initialized, Role: FOLLOWER
I20260806 02:17:16.577811 27502 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7477ef7aa1e846858e7637faefce0940" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36171 } }
I20260806 02:17:16.578063 27502 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:16.578231 27502 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:16.578392 27502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:16.579761 27502 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7477ef7aa1e846858e7637faefce0940" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36171 } }
I20260806 02:17:16.580474 27502 leader_election.cc:302] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7477ef7aa1e846858e7637faefce0940; no voters:
I20260806 02:17:16.580925 27502 leader_election.cc:288] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:16.581334 27509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:16.581624 27509 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [term 1 LEADER]: Becoming Leader. State: Replica: 7477ef7aa1e846858e7637faefce0940, State: Running, Role: LEADER
I20260806 02:17:16.581959 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:16.553364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35836 (local address 127.26.189.190:36171)
0806 02:17:16.553981 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:16.553997 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:16.554067 (+ 70us) server_negotiation.cc:407] Connection header received
0806 02:17:16.559068 (+ 5001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:16.559087 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:16.559529 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:16.559834 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:16.563975 (+ 4141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:16.565404 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:16.567820 (+ 2416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:16.568649 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:16.568839 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:16.574171 (+ 5332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:16.574220 (+ 49us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:16.574239 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:16.574275 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:16.577377 (+ 3102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:16.578015 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:16.578022 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:16.578028 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:16.578255 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:16.578698 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:16.578702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:16.578704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:16.579350 (+ 646us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:16.579555 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:16.580297 (+ 742us) server_negotiation.cc:299] Negotiation successful
0806 02:17:16.580718 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":310,"threads_started":1}
I20260806 02:17:16.582151 27509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7477ef7aa1e846858e7637faefce0940" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36171 } }
I20260806 02:17:16.582777 27502 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:16.586977 27511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7477ef7aa1e846858e7637faefce0940" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7477ef7aa1e846858e7637faefce0940" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36171 } } }
I20260806 02:17:16.587095 27511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:16.586573 27512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7477ef7aa1e846858e7637faefce0940. Latest consensus state: current_term: 1 leader_uuid: "7477ef7aa1e846858e7637faefce0940" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7477ef7aa1e846858e7637faefce0940" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36171 } } }
I20260806 02:17:16.587404 27512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940 [sys.catalog]: This master's current role is: LEADER
W20260806 02:17:16.590430 27526 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:17:16.590561 27526 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:17:16.590654 27527 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:16.591643 27527 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:16.598817 27527 catalog_manager.cc:1347] Generated new cluster ID: 980d26723a2a486dafed6f9626f077c7
I20260806 02:17:16.598893 27527 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:16.607030 27527 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:16.608268 27527 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:16.616868 27527 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7477ef7aa1e846858e7637faefce0940: Generated new TSK 0
I20260806 02:17:16.617780 27527 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:17:16.656985 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36171
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:16.784073 27534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:16.784413 27534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:16.784516 27534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:16.788688 27534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:16.788745 27534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:16.788846 27534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:16.794206 27534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36171
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:16.795405 27534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:16.796459 27534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:16.807325 27540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:16.807350 27539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:16.807389 27542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:16.807689 27534 server_base.cc:1034] running on GCE node
I20260806 02:17:16.808110 27534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:16.808769 27534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:16.809958 27534 hybrid_clock.cc:648] HybridClock initialized: now 1785982636809940 us; error 35 us; skew 500 ppm
Aug 06 02:17:16 dist-test-slave-gkw7 krb5kdc[27394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982636, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:16.817617 27534 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:17:16.818538 27534 webserver.cc:460] Webserver started at http://127.26.189.129:40373/ using document root <none> and password file <none>
I20260806 02:17:16.819135 27534 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:16.819242 27534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:16.819487 27534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:16.821882 27534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "211184a0e39a44a6b2f9caa546e091ae"
format_stamp: "Formatted at 2026-08-06 02:17:16 on dist-test-slave-gkw7"
server_key: "908093d3f743d62096cd994236e699b8"
server_key_iv: "0ed704c00aca83f4d14cf9fb868ea018"
server_key_version: "encryptionkey@0"
I20260806 02:17:16.822553 27534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "211184a0e39a44a6b2f9caa546e091ae"
format_stamp: "Formatted at 2026-08-06 02:17:16 on dist-test-slave-gkw7"
server_key: "908093d3f743d62096cd994236e699b8"
server_key_iv: "0ed704c00aca83f4d14cf9fb868ea018"
server_key_version: "encryptionkey@0"
I20260806 02:17:16.826653 27534 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:16.829152 27552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:16.830515 27534 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:17:16.830657 27534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "211184a0e39a44a6b2f9caa546e091ae"
format_stamp: "Formatted at 2026-08-06 02:17:16 on dist-test-slave-gkw7"
server_key: "908093d3f743d62096cd994236e699b8"
server_key_iv: "0ed704c00aca83f4d14cf9fb868ea018"
server_key_version: "encryptionkey@0"
I20260806 02:17:16.830780 27534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:16.855968 27534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:16.859082 27534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:16.859310 27534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:16.860049 27534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:16.861199 27534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:16.861287 27534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:16.861364 27534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:16.861418 27534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:16.872802 27534 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:34481
I20260806 02:17:16.872830 27702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:34481 every 8 connection(s)
I20260806 02:17:16.873869 27534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:16.874293 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 27534
I20260806 02:17:16.874413 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:17:16.874718 27382 external_mini_cluster.cc:1428] Setting key baaab9f9dd69fc0abce7b3681cccb392
Aug 06 02:17:16 dist-test-slave-gkw7 krb5kdc[27394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982636, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:17:16.889699 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:16.876427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:39967 (local address 127.26.189.190:36171)
0806 02:17:16.876580 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:16.876585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:16.877757 (+ 1172us) server_negotiation.cc:407] Connection header received
0806 02:17:16.879356 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:16.879359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:16.879412 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:16.879523 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:16.880754 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:16.881294 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:16.882585 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:16.882884 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:16.882996 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:16.885869 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:16.885873 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:16.885875 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:16.885897 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:16.887332 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:16.887928 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:16.887931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:16.887932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:16.888012 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:16.888489 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:16.888492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:16.888494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:16.888699 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:16.888816 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:16.889331 (+ 515us) server_negotiation.cc:299] Negotiation successful
0806 02:17:16.889466 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 02:17:16.890530 27707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:16.876986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36171 (local address 127.26.189.129:39967)
0806 02:17:16.877600 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:16.877659 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:16.879123 (+ 1464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:16.879711 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:16.879718 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:16.880098 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:16.880596 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:16.880609 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:16.881425 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:16.881428 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:16.882430 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:16.882441 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:16.883041 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:16.883045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:16.883235 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:16.883977 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:16.883994 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:16.885699 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:16.887462 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:16.887467 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:16.887515 (+ 48us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:16.887816 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:16.888141 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:16.888144 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:16.888146 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:16.888352 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:16.888818 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:16.888826 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:16.889080 (+ 254us) client_negotiation.cc:769] Sending connection context
0806 02:17:16.889276 (+ 196us) client_negotiation.cc:240] Negotiation successful
0806 02:17:16.889656 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":182,"threads_started":1}
I20260806 02:17:16.891934 27704 heartbeater.cc:347] Connected to a master server at 127.26.189.190:36171
I20260806 02:17:16.892216 27704 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:16.892833 27704 heartbeater.cc:511] Master 127.26.189.190:36171 requested a full tablet report, sending...
I20260806 02:17:16.895249 27450 ts_manager.cc:194] Registered new tserver with Master: 211184a0e39a44a6b2f9caa546e091ae (127.26.189.129:34481)
I20260806 02:17:16.896761 27450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:39967
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:17:16.906883 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36171
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:17.026578 27711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:17.026861 27711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:17.026909 27711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:17.031024 27711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:17.031095 27711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:17.031164 27711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:17.036494 27711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36171
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:17.037649 27711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:17.038741 27711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:17.048775 27717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:17.048775 27718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:17.048959 27720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:17.049048 27711 server_base.cc:1034] running on GCE node
I20260806 02:17:17.049598 27711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:17.050355 27711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:17.051509 27711 hybrid_clock.cc:648] HybridClock initialized: now 1785982637051490 us; error 35 us; skew 500 ppm
Aug 06 02:17:17 dist-test-slave-gkw7 krb5kdc[27394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982637, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:17.054571 27711 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:17:17.055473 27711 webserver.cc:460] Webserver started at http://127.26.189.130:38635/ using document root <none> and password file <none>
I20260806 02:17:17.056027 27711 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:17.056087 27711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:17.056268 27711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:17.058459 27711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "cf007e10ad50458aa1976d3b04daaa00"
format_stamp: "Formatted at 2026-08-06 02:17:17 on dist-test-slave-gkw7"
server_key: "1460cf8f9d622b110c854088a0ae8caf"
server_key_iv: "7723911ae08c5edd60edabb24098b490"
server_key_version: "encryptionkey@0"
I20260806 02:17:17.059003 27711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "cf007e10ad50458aa1976d3b04daaa00"
format_stamp: "Formatted at 2026-08-06 02:17:17 on dist-test-slave-gkw7"
server_key: "1460cf8f9d622b110c854088a0ae8caf"
server_key_iv: "7723911ae08c5edd60edabb24098b490"
server_key_version: "encryptionkey@0"
I20260806 02:17:17.062868 27711 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:17.065444 27727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:17.066785 27711 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 02:17:17.066887 27711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "cf007e10ad50458aa1976d3b04daaa00"
format_stamp: "Formatted at 2026-08-06 02:17:17 on dist-test-slave-gkw7"
server_key: "1460cf8f9d622b110c854088a0ae8caf"
server_key_iv: "7723911ae08c5edd60edabb24098b490"
server_key_version: "encryptionkey@0"
I20260806 02:17:17.066980 27711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:17.088595 27711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:17.092080 27711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:17.092319 27711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:17.092948 27711 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:17.093891 27711 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:17.093953 27711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:17.094041 27711 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:17.094076 27711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:17.103454 27711 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:35795
I20260806 02:17:17.103543 27887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:35795 every 8 connection(s)
I20260806 02:17:17.104492 27711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:17.114735 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 27711
I20260806 02:17:17.114861 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
Aug 06 02:17:17 dist-test-slave-gkw7 krb5kdc[27394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982637, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:17.115162 27382 external_mini_cluster.cc:1428] Setting key 3e4ae5a5b748013b26af6aa28a84a685
I20260806 02:17:17.120095 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:17.106781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:48419 (local address 127.26.189.190:36171)
0806 02:17:17.106939 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:17.106944 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:17.107949 (+ 1005us) server_negotiation.cc:407] Connection header received
0806 02:17:17.109329 (+ 1380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:17.109332 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:17.109380 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:17.109458 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:17.110806 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:17.111349 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:17.112575 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:17.112808 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:17.112896 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:17.115846 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:17.115849 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:17.115851 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:17.115878 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:17.117670 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:17.118347 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:17.118350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:17.118351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:17.118429 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:17.118892 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:17.118895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:17.118896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:17.119087 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:17.119206 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:17.119794 (+ 588us) server_negotiation.cc:299] Negotiation successful
0806 02:17:17.119929 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:17:17.121058 27891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:17.107261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36171 (local address 127.26.189.130:48419)
0806 02:17:17.107775 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:17.107825 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:17.109115 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:17.109717 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:17.109725 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:17.110124 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:17.110647 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:17.110676 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:17.111499 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:17.111501 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:17.112450 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:17.112459 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:17.112992 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:17.112996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:17.113159 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:17.113810 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:17.113826 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:17.115615 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:17.117807 (+ 2192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:17.117817 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:17.117839 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:17.118239 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:17.118557 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:17.118563 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:17.118568 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:17.118787 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:17.119209 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:17.119219 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:17.119518 (+ 299us) client_negotiation.cc:769] Sending connection context
0806 02:17:17.119734 (+ 216us) client_negotiation.cc:240] Negotiation successful
0806 02:17:17.120110 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":124,"threads_started":1}
I20260806 02:17:17.122589 27889 heartbeater.cc:347] Connected to a master server at 127.26.189.190:36171
I20260806 02:17:17.122888 27889 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:17.123476 27889 heartbeater.cc:511] Master 127.26.189.190:36171 requested a full tablet report, sending...
I20260806 02:17:17.124755 27450 ts_manager.cc:194] Registered new tserver with Master: cf007e10ad50458aa1976d3b04daaa00 (127.26.189.130:35795)
I20260806 02:17:17.125655 27450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:48419
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:17:17.148214 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36171
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:17.312870 27895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:17.313323 27895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:17.313441 27895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:17.324236 27895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:17.324353 27895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:17.324520 27895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:17.338135 27895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36171
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:17.339906 27895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:17.341502 27895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:17.354715 27904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:17.354969 27902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:17.354715 27901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:17.355198 27895 server_base.cc:1034] running on GCE node
I20260806 02:17:17.355618 27895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:17.356339 27895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:17.357574 27895 hybrid_clock.cc:648] HybridClock initialized: now 1785982637357506 us; error 61 us; skew 500 ppm
Aug 06 02:17:17 dist-test-slave-gkw7 krb5kdc[27394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982637, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:17.360445 27895 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:17:17.361388 27895 webserver.cc:460] Webserver started at http://127.26.189.131:39313/ using document root <none> and password file <none>
I20260806 02:17:17.362007 27895 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:17.362071 27895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:17.362298 27895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:17.364377 27895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "0f725e21bd0544c29834e0661de6297e"
format_stamp: "Formatted at 2026-08-06 02:17:17 on dist-test-slave-gkw7"
server_key: "e2cecfdf10c333a624b5e49d04f32a21"
server_key_iv: "07a000e44e3d920c255e5aa1cb539ba4"
server_key_version: "encryptionkey@0"
I20260806 02:17:17.364948 27895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "0f725e21bd0544c29834e0661de6297e"
format_stamp: "Formatted at 2026-08-06 02:17:17 on dist-test-slave-gkw7"
server_key: "e2cecfdf10c333a624b5e49d04f32a21"
server_key_iv: "07a000e44e3d920c255e5aa1cb539ba4"
server_key_version: "encryptionkey@0"
I20260806 02:17:17.369624 27895 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 02:17:17.372572 27914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:17.373996 27895 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:17:17.374145 27895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "0f725e21bd0544c29834e0661de6297e"
format_stamp: "Formatted at 2026-08-06 02:17:17 on dist-test-slave-gkw7"
server_key: "e2cecfdf10c333a624b5e49d04f32a21"
server_key_iv: "07a000e44e3d920c255e5aa1cb539ba4"
server_key_version: "encryptionkey@0"
I20260806 02:17:17.374284 27895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:17.386515 27895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:17.390074 27895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:17.390302 27895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:17.390920 27895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:17.391865 27895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:17.391939 27895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:17.392014 27895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:17.392066 27895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:17.403658 28071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:46199 every 8 connection(s)
I20260806 02:17:17.403852 27895 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:46199
I20260806 02:17:17.404778 27895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:17.407593 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 27895
I20260806 02:17:17.407744 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:17:17.408099 27382 external_mini_cluster.cc:1428] Setting key c8e4e5f53ae9198c0e9fceb72ed9000b
Aug 06 02:17:17 dist-test-slave-gkw7 krb5kdc[27394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982637, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:17.421136 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:17.407090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:36581 (local address 127.26.189.190:36171)
0806 02:17:17.407292 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:17.407300 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:17.409998 (+ 2698us) server_negotiation.cc:407] Connection header received
0806 02:17:17.411384 (+ 1386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:17.411387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:17.411444 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:17.411546 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:17.412716 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:17.413268 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:17.414535 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:17.414770 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:17.414884 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:17.417403 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:17.417407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:17.417410 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:17.417442 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:17.418986 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:17.419565 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:17.419569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:17.419571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:17.419661 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:17.420025 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:17.420030 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:17.420032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:17.420229 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:17.420342 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:17.420841 (+ 499us) server_negotiation.cc:299] Negotiation successful
0806 02:17:17.420969 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 02:17:17.422142 28075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:17.407493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36171 (local address 127.26.189.131:36581)
0806 02:17:17.409815 (+ 2322us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:17.409884 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:17.411167 (+ 1283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:17.411715 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:17.411722 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:17.412086 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:17.412576 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:17.412588 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:17.413397 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:17.413406 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:17.414407 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:17.414417 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:17.414926 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:17.414930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:17.415097 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:17.415757 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:17.415774 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:17.417237 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:17.419110 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:17.419117 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:17.419133 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:17.419461 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:17.419778 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:17.419781 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:17.419783 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:17.419927 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:17.420342 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:17.420350 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:17.420599 (+ 249us) client_negotiation.cc:769] Sending connection context
0806 02:17:17.420801 (+ 202us) client_negotiation.cc:240] Negotiation successful
0806 02:17:17.421134 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2130,"thread_start_us":145,"threads_started":1}
I20260806 02:17:17.423393 28073 heartbeater.cc:347] Connected to a master server at 127.26.189.190:36171
I20260806 02:17:17.423646 28073 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:17.424177 28073 heartbeater.cc:511] Master 127.26.189.190:36171 requested a full tablet report, sending...
I20260806 02:17:17.425307 27450 ts_manager.cc:194] Registered new tserver with Master: 0f725e21bd0544c29834e0661de6297e (127.26.189.131:46199)
I20260806 02:17:17.426270 27450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:36581
I20260806 02:17:17.435818 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 02:17:17 dist-test-slave-gkw7 krb5kdc[27394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982637, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 02:17:17 dist-test-slave-gkw7 krb5kdc[27394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982637, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.189.129@KRBTEST.COM
I20260806 02:17:17.466473 28083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:17.457310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40434 (local address 127.26.189.129:34481)
0806 02:17:17.457717 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:17.457724 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:17.457750 (+ 26us) server_negotiation.cc:407] Connection header received
0806 02:17:17.457804 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:17.457810 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:17.458005 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:17.458133 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:17.458781 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:17.459546 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:17.460347 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:17.460724 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:17.460807 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:17.463181 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:17.463191 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:17.463205 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:17.463228 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:17.464679 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:17.465074 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:17.465079 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:17.465080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:17.465163 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:17.465422 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:17.465425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:17.465426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:17.465746 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:17.465910 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:17.466093 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 02:17:17.466269 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":106,"threads_started":1}
W20260806 02:17:17.467617 27587 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40434
Aug 06 02:17:17 dist-test-slave-gkw7 krb5kdc[27394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 02:17:17 dist-test-slave-gkw7 krb5kdc[27394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.129@KRBTEST.COM
I20260806 02:17:17.496944 28083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:17.488412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40436 (local address 127.26.189.129:34481)
0806 02:17:17.488616 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:17.488622 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:17.488641 (+ 19us) server_negotiation.cc:407] Connection header received
0806 02:17:17.488768 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:17.488771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:17.488819 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:17.488902 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:17.489658 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:17.490234 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:17.491051 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:17.491299 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:17.491386 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:17.494041 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:17.494044 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:17.494047 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:17.494073 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:17.495370 (+ 1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:17.495770 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:17.495772 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:17.495774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:17.495856 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:17.496097 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:17.496099 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:17.496100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:17.496271 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:17.496383 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:17.496577 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 02:17:17.496686 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260806 02:17:17.498356 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 27534
I20260806 02:17:17.510809 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 27711
I20260806 02:17:17.529263 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 27895
I20260806 02:17:17.542784 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 27413
2026-08-06T02:17:17Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2630 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:17 dist-test-slave-gkw7 krb5kdc[28093](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:17 dist-test-slave-gkw7 krb5kdc[28093](info): set up 2 sockets
Aug 06 02:17:17 dist-test-slave-gkw7 krb5kdc[28093](info): commencing operation
krb5kdc: starting...
W20260806 02:17:18.834827 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:18 dist-test-slave-gkw7 krb5kdc[28093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:17:18.966696 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:44865
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:44865
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:19.082525 28112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:19.082862 28112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:19.082906 28112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:19.087093 28112 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:19.087162 28112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:19.087181 28112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:19.087198 28112 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:19.087294 28112 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:19.092658 28112 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:44865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:44865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:19.093905 28112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:19.095007 28112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:19.104034 28120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:19.104063 28126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:19.104269 28112 server_base.cc:1034] running on GCE node
W20260806 02:17:19.104035 28121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:19.105023 28112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:19.106288 28112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:19.107460 28112 hybrid_clock.cc:648] HybridClock initialized: now 1785982639107443 us; error 31 us; skew 500 ppm
Aug 06 02:17:19 dist-test-slave-gkw7 krb5kdc[28093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982639, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:19.110363 28112 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:17:19.111577 28112 webserver.cc:460] Webserver started at http://127.26.189.190:45815/ using document root <none> and password file <none>
I20260806 02:17:19.112279 28112 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:19.112350 28112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:19.112525 28112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:19.114753 28112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "479969ca65424ba5bca64c1a89d6a4f2"
format_stamp: "Formatted at 2026-08-06 02:17:19 on dist-test-slave-gkw7"
server_key: "3cbc8eb081261d2d84f36ac28e83ffea"
server_key_iv: "18951a3c7b8b45e5187996106d7ea62c"
server_key_version: "encryptionkey@0"
I20260806 02:17:19.115319 28112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "479969ca65424ba5bca64c1a89d6a4f2"
format_stamp: "Formatted at 2026-08-06 02:17:19 on dist-test-slave-gkw7"
server_key: "3cbc8eb081261d2d84f36ac28e83ffea"
server_key_iv: "18951a3c7b8b45e5187996106d7ea62c"
server_key_version: "encryptionkey@0"
I20260806 02:17:19.119488 28112 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:19.122148 28135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:19.123469 28112 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:19.123626 28112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "479969ca65424ba5bca64c1a89d6a4f2"
format_stamp: "Formatted at 2026-08-06 02:17:19 on dist-test-slave-gkw7"
server_key: "3cbc8eb081261d2d84f36ac28e83ffea"
server_key_iv: "18951a3c7b8b45e5187996106d7ea62c"
server_key_version: "encryptionkey@0"
I20260806 02:17:19.123764 28112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:19.138043 28112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:19.141297 28112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:19.141518 28112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:19.149125 28112 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:44865
I20260806 02:17:19.149153 28204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:44865 every 8 connection(s)
I20260806 02:17:19.150161 28112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:19.152936 28205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:19.154003 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 28112
I20260806 02:17:19.154126 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:19.154433 27382 external_mini_cluster.cc:1428] Setting key 1696a49aab0c3707aed940e8a4a9d5c0
I20260806 02:17:19.159526 28205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2: Bootstrap starting.
I20260806 02:17:19.161839 28205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:19.162879 28205 log.cc:824] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2: Log is configured to *not* fsync() on all Append() calls
Aug 06 02:17:19 dist-test-slave-gkw7 krb5kdc[28093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:19.165244 28205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2: No bootstrap required, opened a new log
I20260806 02:17:19.169819 28209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.155930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57118 (local address 127.26.189.190:44865)
0806 02:17:19.156377 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:19.156392 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:19.156428 (+ 36us) server_negotiation.cc:407] Connection header received
0806 02:17:19.157066 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:19.157084 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:19.157422 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:19.157897 (+ 475us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:19.158763 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.159828 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.160698 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.161192 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.161373 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.164427 (+ 3054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:19.164433 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:19.164449 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:19.164480 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:19.166452 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:19.166893 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:19.166900 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:19.166907 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:19.167053 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:19.167317 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:19.167323 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:19.167326 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:19.167985 (+ 659us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:19.168306 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:19.168501 (+ 195us) server_negotiation.cc:299] Negotiation successful
0806 02:17:19.168815 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":131,"threads_started":1}
I20260806 02:17:19.170516 28205 raft_consensus.cc:348] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479969ca65424ba5bca64c1a89d6a4f2" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44865 } }
I20260806 02:17:19.170794 28205 raft_consensus.cc:374] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:19.170902 28205 raft_consensus.cc:729] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479969ca65424ba5bca64c1a89d6a4f2, State: Initialized, Role: FOLLOWER
I20260806 02:17:19.171372 28205 consensus_queue.cc:260] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479969ca65424ba5bca64c1a89d6a4f2" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44865 } }
I20260806 02:17:19.171497 28205 raft_consensus.cc:388] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:19.171586 28205 raft_consensus.cc:482] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:19.171684 28205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:19.172765 28205 raft_consensus.cc:504] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479969ca65424ba5bca64c1a89d6a4f2" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44865 } }
I20260806 02:17:19.173107 28205 leader_election.cc:302] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 479969ca65424ba5bca64c1a89d6a4f2; no voters:
I20260806 02:17:19.173454 28205 leader_election.cc:288] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:19.173575 28212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:19.173760 28212 raft_consensus.cc:686] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [term 1 LEADER]: Becoming Leader. State: Replica: 479969ca65424ba5bca64c1a89d6a4f2, State: Running, Role: LEADER
I20260806 02:17:19.174111 28212 consensus_queue.cc:237] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479969ca65424ba5bca64c1a89d6a4f2" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44865 } }
I20260806 02:17:19.174794 28205 sys_catalog.cc:564] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:19.175361 28212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 479969ca65424ba5bca64c1a89d6a4f2. Latest consensus state: current_term: 1 leader_uuid: "479969ca65424ba5bca64c1a89d6a4f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479969ca65424ba5bca64c1a89d6a4f2" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44865 } } }
I20260806 02:17:19.175554 28212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:19.176017 28220 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:19.176226 28214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "479969ca65424ba5bca64c1a89d6a4f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479969ca65424ba5bca64c1a89d6a4f2" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44865 } } }
I20260806 02:17:19.176492 28214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:19.179252 28220 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:19.184600 28220 catalog_manager.cc:1347] Generated new cluster ID: 16a7b199fc914c35b685c4069a98bda6
I20260806 02:17:19.184666 28220 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:19.203454 28220 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:19.204460 28220 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:19.212188 28220 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 479969ca65424ba5bca64c1a89d6a4f2: Generated new TSK 0
I20260806 02:17:19.212891 28220 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:17:19.249708 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:44865
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:19.370663 28238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:19.370987 28238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:19.371032 28238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:19.375240 28238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:19.375300 28238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:19.375401 28238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:19.380820 28238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:44865
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:19.382047 28238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:19.383138 28238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:19.392952 28248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:19.392967 28245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:19.392967 28246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:19.393376 28238 server_base.cc:1034] running on GCE node
I20260806 02:17:19.393821 28238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:19.394477 28238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:19.395668 28238 hybrid_clock.cc:648] HybridClock initialized: now 1785982639395650 us; error 30 us; skew 500 ppm
Aug 06 02:17:19 dist-test-slave-gkw7 krb5kdc[28093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982639, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:19.398573 28238 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:17:19.399466 28238 webserver.cc:460] Webserver started at http://127.26.189.129:46299/ using document root <none> and password file <none>
I20260806 02:17:19.400090 28238 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:19.400187 28238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:19.400435 28238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:19.402657 28238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "f97f4d9c29ab493589231f704523ad33"
format_stamp: "Formatted at 2026-08-06 02:17:19 on dist-test-slave-gkw7"
server_key: "83eac6d5e7d1a85c262997106a130d98"
server_key_iv: "789649e93168a2e0fd83999849b21c70"
server_key_version: "encryptionkey@0"
I20260806 02:17:19.403270 28238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "f97f4d9c29ab493589231f704523ad33"
format_stamp: "Formatted at 2026-08-06 02:17:19 on dist-test-slave-gkw7"
server_key: "83eac6d5e7d1a85c262997106a130d98"
server_key_iv: "789649e93168a2e0fd83999849b21c70"
server_key_version: "encryptionkey@0"
I20260806 02:17:19.407119 28238 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:19.409684 28256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:19.410951 28238 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:17:19.411099 28238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "f97f4d9c29ab493589231f704523ad33"
format_stamp: "Formatted at 2026-08-06 02:17:19 on dist-test-slave-gkw7"
server_key: "83eac6d5e7d1a85c262997106a130d98"
server_key_iv: "789649e93168a2e0fd83999849b21c70"
server_key_version: "encryptionkey@0"
I20260806 02:17:19.411216 28238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:19.440757 28238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:19.444276 28238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:19.444492 28238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:19.445132 28238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:19.446084 28238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:19.446157 28238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:19.446229 28238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:19.446280 28238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:19.455498 28238 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:45833
I20260806 02:17:19.455523 28414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:45833 every 8 connection(s)
I20260806 02:17:19.456450 28238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:19.458900 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 28238
I20260806 02:17:19.459025 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:17:19.459247 27382 external_mini_cluster.cc:1428] Setting key a9c0ecffcdfb82760c03bd3a403927b2
Aug 06 02:17:19 dist-test-slave-gkw7 krb5kdc[28093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982639, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
I20260806 02:17:19.471990 28209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.458483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:55077 (local address 127.26.189.190:44865)
0806 02:17:19.458639 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:19.458644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:19.459662 (+ 1018us) server_negotiation.cc:407] Connection header received
0806 02:17:19.461035 (+ 1373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:19.461038 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:19.461096 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:19.461184 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:19.462447 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.463113 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.464634 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.465079 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.465209 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.468052 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:19.468058 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:19.468064 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:19.468095 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:19.469796 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:19.470377 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:19.470382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:19.470385 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:19.470489 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:19.470861 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:19.470864 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:19.470865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:19.471051 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:19.471132 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:19.471748 (+ 616us) server_negotiation.cc:299] Negotiation successful
0806 02:17:19.471861 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:17:19.472927 28418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.459004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:44865 (local address 127.26.189.129:55077)
0806 02:17:19.459501 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:19.459557 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:19.460823 (+ 1266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:19.461326 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:19.461333 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:19.461772 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:19.462285 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:19.462300 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.463254 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.463260 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:19.464499 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:19.464509 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.465238 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.465241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:19.465386 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.466060 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:19.466077 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:19.467865 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:19.469922 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:19.469927 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:19.469940 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:19.470219 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:19.470590 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:19.470592 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:19.470593 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:19.470735 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:19.471144 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:19.471149 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:19.471435 (+ 286us) client_negotiation.cc:769] Sending connection context
0806 02:17:19.471679 (+ 244us) client_negotiation.cc:240] Negotiation successful
0806 02:17:19.472010 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":141,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:17:19.474282 28416 heartbeater.cc:347] Connected to a master server at 127.26.189.190:44865
I20260806 02:17:19.474555 28416 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:19.475138 28416 heartbeater.cc:511] Master 127.26.189.190:44865 requested a full tablet report, sending...
I20260806 02:17:19.476966 28159 ts_manager.cc:194] Registered new tserver with Master: f97f4d9c29ab493589231f704523ad33 (127.26.189.129:45833)
I20260806 02:17:19.478721 28159 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:55077
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:17:19.492892 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:44865
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:19.608664 28421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:19.609023 28421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:19.609102 28421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:19.613557 28421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:19.613680 28421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:19.613775 28421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:19.619477 28421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:44865
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:19.620664 28421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:19.621846 28421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:19.632187 28427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:19.632246 28433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:19.632205 28428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:19.632530 28421 server_base.cc:1034] running on GCE node
I20260806 02:17:19.632931 28421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:19.633697 28421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:19.634882 28421 hybrid_clock.cc:648] HybridClock initialized: now 1785982639634864 us; error 29 us; skew 500 ppm
Aug 06 02:17:19 dist-test-slave-gkw7 krb5kdc[28093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982639, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:19.637899 28421 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:17:19.638845 28421 webserver.cc:460] Webserver started at http://127.26.189.130:46085/ using document root <none> and password file <none>
I20260806 02:17:19.639456 28421 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:19.639519 28421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:19.639743 28421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:19.641978 28421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c"
format_stamp: "Formatted at 2026-08-06 02:17:19 on dist-test-slave-gkw7"
server_key: "cb1a4f28df71aa537edd4edc799f42b1"
server_key_iv: "e6e2cf84a5d7d694055cf6e68cf96e6a"
server_key_version: "encryptionkey@0"
I20260806 02:17:19.642593 28421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c"
format_stamp: "Formatted at 2026-08-06 02:17:19 on dist-test-slave-gkw7"
server_key: "cb1a4f28df71aa537edd4edc799f42b1"
server_key_iv: "e6e2cf84a5d7d694055cf6e68cf96e6a"
server_key_version: "encryptionkey@0"
I20260806 02:17:19.646400 28421 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 02:17:19.648854 28443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:19.650202 28421 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:17:19.650372 28421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c"
format_stamp: "Formatted at 2026-08-06 02:17:19 on dist-test-slave-gkw7"
server_key: "cb1a4f28df71aa537edd4edc799f42b1"
server_key_iv: "e6e2cf84a5d7d694055cf6e68cf96e6a"
server_key_version: "encryptionkey@0"
I20260806 02:17:19.650483 28421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:19.671356 28421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:19.674510 28421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:19.674714 28421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:19.675349 28421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:19.676244 28421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:19.676293 28421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:19.676364 28421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:19.676400 28421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:19.685926 28421 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:34833
I20260806 02:17:19.685952 28582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:34833 every 8 connection(s)
I20260806 02:17:19.686863 28421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:19.690419 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 28421
I20260806 02:17:19.690531 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:17:19.690848 27382 external_mini_cluster.cc:1428] Setting key e1306502f55b807954f764f653b5689b
Aug 06 02:17:19 dist-test-slave-gkw7 krb5kdc[28093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982639, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
I20260806 02:17:19.704047 28209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.688699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:47951 (local address 127.26.189.190:44865)
0806 02:17:19.688882 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:19.688887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:19.690621 (+ 1734us) server_negotiation.cc:407] Connection header received
0806 02:17:19.692254 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:19.692257 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:19.692313 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:19.692373 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:19.694332 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.694870 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.696556 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.696974 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.697103 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.699998 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:19.700002 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:19.700006 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:19.700040 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:19.701847 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:19.702374 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:19.702380 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:19.702384 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:19.702490 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:19.702896 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:19.702898 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:19.702900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:19.703090 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:19.703169 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:19.703714 (+ 545us) server_negotiation.cc:299] Negotiation successful
0806 02:17:19.703865 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 02:17:19.704903 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.689209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:44865 (local address 127.26.189.130:47951)
0806 02:17:19.690436 (+ 1227us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:19.690502 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:19.691993 (+ 1491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:19.692808 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:19.692817 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:19.693385 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:19.694137 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:19.694161 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.695007 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.695013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:19.696422 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:19.696432 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.697127 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.697130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:19.697286 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.697968 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:19.697985 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:19.699809 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:19.701971 (+ 2162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:19.701976 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:19.701989 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:19.702252 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:19.702637 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:19.702640 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:19.702641 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:19.702785 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:19.703184 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:19.703189 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:19.703448 (+ 259us) client_negotiation.cc:769] Sending connection context
0806 02:17:19.703645 (+ 197us) client_negotiation.cc:240] Negotiation successful
0806 02:17:19.703993 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":947,"thread_start_us":168,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
I20260806 02:17:19.706316 28583 heartbeater.cc:347] Connected to a master server at 127.26.189.190:44865
I20260806 02:17:19.706595 28583 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:19.707212 28583 heartbeater.cc:511] Master 127.26.189.190:44865 requested a full tablet report, sending...
I20260806 02:17:19.708493 28159 ts_manager.cc:194] Registered new tserver with Master: 9e5f35e439ab4de9b4a0991a7bc3b82c (127.26.189.130:34833)
I20260806 02:17:19.709098 28159 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:47951
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:17:19.722759 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:44865
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:19.836796 28590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:19.837046 28590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:19.837090 28590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:19.841113 28590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:19.841166 28590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:19.841221 28590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:19.846350 28590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:44865
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:19.847390 28590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:19.848374 28590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:19.858194 28595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:19.858310 28590 server_base.cc:1034] running on GCE node
W20260806 02:17:19.858158 28600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:19.858211 28596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:19.858814 28590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:19.859484 28590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:19.860716 28590 hybrid_clock.cc:648] HybridClock initialized: now 1785982639860708 us; error 30 us; skew 500 ppm
Aug 06 02:17:19 dist-test-slave-gkw7 krb5kdc[28093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982639, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:19.863583 28590 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:17:19.864559 28590 webserver.cc:460] Webserver started at http://127.26.189.131:37711/ using document root <none> and password file <none>
I20260806 02:17:19.865161 28590 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:19.865262 28590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:19.865514 28590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:19.867697 28590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7"
format_stamp: "Formatted at 2026-08-06 02:17:19 on dist-test-slave-gkw7"
server_key: "7d440f54e147ab3f3ee3682c16bbf505"
server_key_iv: "5be5e9a3643f9aaaf7b555c6069c3d25"
server_key_version: "encryptionkey@0"
I20260806 02:17:19.868300 28590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7"
format_stamp: "Formatted at 2026-08-06 02:17:19 on dist-test-slave-gkw7"
server_key: "7d440f54e147ab3f3ee3682c16bbf505"
server_key_iv: "5be5e9a3643f9aaaf7b555c6069c3d25"
server_key_version: "encryptionkey@0"
I20260806 02:17:19.872179 28590 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:17:19.874701 28611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:19.876279 28590 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:17:19.876421 28590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7"
format_stamp: "Formatted at 2026-08-06 02:17:19 on dist-test-slave-gkw7"
server_key: "7d440f54e147ab3f3ee3682c16bbf505"
server_key_iv: "5be5e9a3643f9aaaf7b555c6069c3d25"
server_key_version: "encryptionkey@0"
I20260806 02:17:19.876536 28590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:19.889977 28590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:19.892920 28590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:19.893126 28590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:19.893795 28590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:19.894755 28590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:19.894835 28590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:19.894909 28590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:19.894964 28590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:19.904253 28590 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:34577
I20260806 02:17:19.904277 28762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:34577 every 8 connection(s)
I20260806 02:17:19.905193 28590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:19.910552 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 28590
I20260806 02:17:19.910694 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:17:19.911000 27382 external_mini_cluster.cc:1428] Setting key 576e257ecb6d811514c942063c91df2f
Aug 06 02:17:19 dist-test-slave-gkw7 krb5kdc[28093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982639, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:19.919409 28209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.907068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:37731 (local address 127.26.189.190:44865)
0806 02:17:19.907254 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:19.907260 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:19.908081 (+ 821us) server_negotiation.cc:407] Connection header received
0806 02:17:19.909303 (+ 1222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:19.909306 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:19.909354 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:19.909432 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:19.910669 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.911430 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.913126 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.913456 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.913615 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.916076 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:19.916079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:19.916081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:19.916107 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:19.917636 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:19.918093 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:19.918096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:19.918097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:19.918175 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:19.918483 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:19.918485 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:19.918486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:19.918659 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:19.918750 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:19.919188 (+ 438us) server_negotiation.cc:299] Negotiation successful
0806 02:17:19.919288 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 02:17:19.920245 28766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.907459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:44865 (local address 127.26.189.131:37731)
0806 02:17:19.907926 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:19.907969 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:19.909103 (+ 1134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:19.909656 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:19.909664 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:19.910014 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:19.910509 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:19.910522 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.911568 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.911571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:19.912992 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:19.913002 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.913638 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.913642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:19.913829 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.914366 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:19.914382 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:19.915918 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:19.917738 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:19.917743 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:19.917755 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:19.918004 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:19.918267 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:19.918269 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:19.918271 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:19.918403 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:19.918749 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:19.918754 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:19.918983 (+ 229us) client_negotiation.cc:769] Sending connection context
0806 02:17:19.919139 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 02:17:19.919402 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":119,"threads_started":1}
I20260806 02:17:19.921418 28763 heartbeater.cc:347] Connected to a master server at 127.26.189.190:44865
I20260806 02:17:19.921696 28763 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:19.922209 28763 heartbeater.cc:511] Master 127.26.189.190:44865 requested a full tablet report, sending...
I20260806 02:17:19.923271 28159 ts_manager.cc:194] Registered new tserver with Master: 9c48367c7cc04a30bcfdeedd45f2e5e7 (127.26.189.131:34577)
I20260806 02:17:19.924083 28159 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:37731
I20260806 02:17:19.925423 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:17:19.936949 28209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.929859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57120 (local address 127.26.189.190:44865)
0806 02:17:19.929988 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:19.929992 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:19.930129 (+ 137us) server_negotiation.cc:407] Connection header received
0806 02:17:19.930235 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:19.930237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:19.930277 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:19.930346 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:19.931011 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.931508 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.932293 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.932502 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.932579 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.933941 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:19.933944 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:19.933946 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:19.933969 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:19.935403 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:19.935777 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:19.935780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:19.935781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:19.935856 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:19.936080 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:19.936082 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:19.936083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:19.936289 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:19.936417 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:19.936723 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 02:17:19.936830 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 02:17:19.942955 28159 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57120:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:17:19.946260 28159 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:19.962908 28785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.957697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52296 (local address 127.26.189.129:45833)
0806 02:17:19.958348 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:19.958364 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:19.958389 (+ 25us) server_negotiation.cc:407] Connection header received
0806 02:17:19.958466 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:19.958470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:19.958613 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:19.958903 (+ 290us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:19.959085 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.960053 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.961521 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.962148 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.962292 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.962500 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:19.962644 (+ 144us) server_negotiation.cc:299] Negotiation successful
0806 02:17:19.962748 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":107,"threads_started":1}
I20260806 02:17:19.962898 28784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.957500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:45833 (local address 127.0.0.1:52296)
0806 02:17:19.958144 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:19.958156 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:19.958245 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:19.958791 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:19.958794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:19.958806 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:19.958969 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:19.958977 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.960200 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.960204 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:19.961392 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:19.961401 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.962284 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.962288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:19.962420 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.962463 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 02:17:19.962610 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 02:17:19.962743 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"mutex_wait_us":16,"thread_start_us":122,"threads_started":1}
I20260806 02:17:19.963136 28779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.957007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:34833 (local address 127.0.0.1:54772)
0806 02:17:19.957699 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:19.957759 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:19.957900 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:19.958958 (+ 1058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:19.958961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:19.958982 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:19.959083 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:19.959090 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.960627 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.960634 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:19.961641 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:19.961654 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.962754 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.962758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:19.962847 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.962872 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 02:17:19.962923 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 02:17:19.962990 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":55,"spinlock_wait_cycles":7040,"thread_start_us":109,"threads_started":1}
I20260806 02:17:19.964316 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.958071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54772 (local address 127.26.189.130:34833)
0806 02:17:19.958494 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:19.958506 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:19.958527 (+ 21us) server_negotiation.cc:407] Connection header received
0806 02:17:19.958599 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:19.958603 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:19.958787 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:19.958975 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:19.959217 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.960459 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.961790 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.962624 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.963826 (+ 1202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.963955 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:19.964010 (+ 55us) server_negotiation.cc:299] Negotiation successful
0806 02:17:19.964119 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":145,"threads_started":1}
I20260806 02:17:19.965668 28783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.956704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:34577 (local address 127.0.0.1:53282)
0806 02:17:19.957699 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:19.957759 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:19.957900 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:19.958752 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:19.958760 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:19.958790 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:19.959285 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:19.959292 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.960659 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.960662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:19.962472 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:19.962484 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.963600 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.963606 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:19.963708 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.963751 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 02:17:19.963802 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 02:17:19.963870 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"mutex_wait_us":5,"spinlock_wait_cycles":6656,"thread_start_us":94,"threads_started":1}
I20260806 02:17:19.966405 28781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:19.956911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53282 (local address 127.26.189.131:34577)
0806 02:17:19.958199 (+ 1288us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:19.958213 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:19.958253 (+ 40us) server_negotiation.cc:407] Connection header received
0806 02:17:19.958341 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:19.958346 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:19.958565 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:19.958726 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:19.959414 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.960520 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.962623 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:19.963450 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:19.965970 (+ 2520us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:19.966100 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:19.966151 (+ 51us) server_negotiation.cc:299] Negotiation successful
0806 02:17:19.966264 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1179,"thread_start_us":119,"threads_started":1}
I20260806 02:17:19.966626 28327 tablet_service.cc:1467] Processing CreateTablet for tablet 469341cabef444ad84136eed9cc3fedc (DEFAULT_TABLE table=test-table [id=ac4dbb425d3248c38eb191461ec43dae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:19.967226 28505 tablet_service.cc:1467] Processing CreateTablet for tablet 469341cabef444ad84136eed9cc3fedc (DEFAULT_TABLE table=test-table [id=ac4dbb425d3248c38eb191461ec43dae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:19.968014 28327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 469341cabef444ad84136eed9cc3fedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:19.968276 28505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 469341cabef444ad84136eed9cc3fedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:19.969054 28670 tablet_service.cc:1467] Processing CreateTablet for tablet 469341cabef444ad84136eed9cc3fedc (DEFAULT_TABLE table=test-table [id=ac4dbb425d3248c38eb191461ec43dae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:19.970050 28670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 469341cabef444ad84136eed9cc3fedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:19.975049 28790 tablet_bootstrap.cc:492] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c: Bootstrap starting.
I20260806 02:17:19.976452 28791 tablet_bootstrap.cc:492] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33: Bootstrap starting.
I20260806 02:17:19.977052 28792 tablet_bootstrap.cc:492] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7: Bootstrap starting.
I20260806 02:17:19.978406 28790 tablet_bootstrap.cc:654] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:19.978674 28791 tablet_bootstrap.cc:654] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:19.979365 28791 log.cc:824] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:19.979372 28790 log.cc:824] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:19.979417 28792 tablet_bootstrap.cc:654] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:19.980792 28792 log.cc:824] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:19.981662 28790 tablet_bootstrap.cc:492] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c: No bootstrap required, opened a new log
I20260806 02:17:19.981662 28791 tablet_bootstrap.cc:492] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33: No bootstrap required, opened a new log
I20260806 02:17:19.981884 28791 ts_tablet_manager.cc:1397] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:17:19.981884 28790 ts_tablet_manager.cc:1397] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260806 02:17:19.982618 28792 tablet_bootstrap.cc:492] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7: No bootstrap required, opened a new log
I20260806 02:17:19.982858 28792 ts_tablet_manager.cc:1397] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 02:17:19.986076 28792 raft_consensus.cc:348] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34577 } } peers { permanent_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 34833 } } peers { permanent_uuid: "f97f4d9c29ab493589231f704523ad33" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45833 } }
I20260806 02:17:19.986032 28790 raft_consensus.cc:348] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34577 } } peers { permanent_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 34833 } } peers { permanent_uuid: "f97f4d9c29ab493589231f704523ad33" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45833 } }
I20260806 02:17:19.986327 28792 raft_consensus.cc:374] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:19.986338 28790 raft_consensus.cc:374] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:19.986398 28790 raft_consensus.cc:729] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e5f35e439ab4de9b4a0991a7bc3b82c, State: Initialized, Role: FOLLOWER
I20260806 02:17:19.986404 28792 raft_consensus.cc:729] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c48367c7cc04a30bcfdeedd45f2e5e7, State: Initialized, Role: FOLLOWER
I20260806 02:17:19.986284 28791 raft_consensus.cc:348] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34577 } } peers { permanent_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 34833 } } peers { permanent_uuid: "f97f4d9c29ab493589231f704523ad33" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45833 } }
I20260806 02:17:19.986511 28791 raft_consensus.cc:374] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:19.986568 28791 raft_consensus.cc:729] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97f4d9c29ab493589231f704523ad33, State: Initialized, Role: FOLLOWER
I20260806 02:17:19.986892 28790 consensus_queue.cc:260] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34577 } } peers { permanent_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 34833 } } peers { permanent_uuid: "f97f4d9c29ab493589231f704523ad33" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45833 } }
I20260806 02:17:19.986920 28791 consensus_queue.cc:260] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34577 } } peers { permanent_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 34833 } } peers { permanent_uuid: "f97f4d9c29ab493589231f704523ad33" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45833 } }
I20260806 02:17:19.986987 28792 consensus_queue.cc:260] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34577 } } peers { permanent_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 34833 } } peers { permanent_uuid: "f97f4d9c29ab493589231f704523ad33" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45833 } }
I20260806 02:17:19.987702 28583 heartbeater.cc:503] Master 127.26.189.190:44865 was elected leader, sending a full tablet report...
I20260806 02:17:19.987938 28790 ts_tablet_manager.cc:1428] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:17:19.987926 28416 heartbeater.cc:503] Master 127.26.189.190:44865 was elected leader, sending a full tablet report...
I20260806 02:17:19.988315 28791 ts_tablet_manager.cc:1428] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:17:19.989009 28792 ts_tablet_manager.cc:1428] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:17:19.989346 28763 heartbeater.cc:503] Master 127.26.189.190:44865 was elected leader, sending a full tablet report...
I20260806 02:17:20.067521 28797 raft_consensus.cc:482] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:20.067745 28797 raft_consensus.cc:504] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34577 } } peers { permanent_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 34833 } } peers { permanent_uuid: "f97f4d9c29ab493589231f704523ad33" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45833 } }
I20260806 02:17:20.068953 28797 leader_election.cc:288] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c48367c7cc04a30bcfdeedd45f2e5e7 (127.26.189.131:34577), f97f4d9c29ab493589231f704523ad33 (127.26.189.129:45833)
I20260806 02:17:20.071452 28799 raft_consensus.cc:482] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:20.071645 28799 raft_consensus.cc:504] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34577 } } peers { permanent_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 34833 } } peers { permanent_uuid: "f97f4d9c29ab493589231f704523ad33" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45833 } }
I20260806 02:17:20.073079 28781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:20.069349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:36827 (local address 127.26.189.131:34577)
0806 02:17:20.069493 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:20.069497 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:20.069515 (+ 18us) server_negotiation.cc:407] Connection header received
0806 02:17:20.069674 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:20.069681 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:20.069758 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:20.069849 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:20.070161 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.070664 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.072066 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.072491 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.072629 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:20.072684 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:20.072877 (+ 193us) server_negotiation.cc:299] Negotiation successful
0806 02:17:20.072952 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 02:17:20.073079 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:20.069173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:34577 (local address 127.26.189.130:36827)
0806 02:17:20.069362 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:20.069378 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:20.069516 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:20.069868 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:20.069872 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:20.069890 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:20.070014 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:20.070020 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.070806 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.070813 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:20.071931 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:20.071943 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.072622 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.072626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:20.072734 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:20.072758 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 02:17:20.072858 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 02:17:20.072936 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":31}
I20260806 02:17:20.074055 28785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:20.069684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:48557 (local address 127.26.189.129:45833)
0806 02:17:20.069829 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:20.069835 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:20.070063 (+ 228us) server_negotiation.cc:407] Connection header received
0806 02:17:20.070191 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:20.070196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:20.070253 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:20.070340 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:20.070618 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.071175 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.072652 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.073243 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.073350 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:20.073396 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:20.073820 (+ 424us) server_negotiation.cc:299] Negotiation successful
0806 02:17:20.073925 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 02:17:20.074009 28697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469341cabef444ad84136eed9cc3fedc" candidate_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" is_pre_election: true
I20260806 02:17:20.074352 28799 leader_election.cc:288] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c48367c7cc04a30bcfdeedd45f2e5e7 (127.26.189.131:34577), 9e5f35e439ab4de9b4a0991a7bc3b82c (127.26.189.130:34833)
I20260806 02:17:20.074527 28697 raft_consensus.cc:2454] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e5f35e439ab4de9b4a0991a7bc3b82c in term 0.
I20260806 02:17:20.074914 28801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:20.069556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:45833 (local address 127.26.189.130:48557)
0806 02:17:20.069967 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:20.069978 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:20.070097 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:20.070349 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:20.070352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:20.070368 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:20.070506 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:20.070511 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.071295 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.071301 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:20.072501 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:20.072514 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.073516 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.073521 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:20.073655 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:20.073679 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 02:17:20.074655 (+ 976us) client_negotiation.cc:240] Negotiation successful
0806 02:17:20.074741 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":1,"thread_start_us":145,"threads_started":1}
I20260806 02:17:20.075160 28449 leader_election.cc:302] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c48367c7cc04a30bcfdeedd45f2e5e7, 9e5f35e439ab4de9b4a0991a7bc3b82c; no voters:
I20260806 02:17:20.075481 28797 raft_consensus.cc:2781] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:20.075646 28797 raft_consensus.cc:482] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:20.075778 28797 raft_consensus.cc:3037] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:20.076027 28355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469341cabef444ad84136eed9cc3fedc" candidate_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97f4d9c29ab493589231f704523ad33" is_pre_election: true
I20260806 02:17:20.076268 28355 raft_consensus.cc:2454] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e5f35e439ab4de9b4a0991a7bc3b82c in term 0.
I20260806 02:17:20.078022 28797 raft_consensus.cc:504] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34577 } } peers { permanent_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 34833 } } peers { permanent_uuid: "f97f4d9c29ab493589231f704523ad33" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45833 } }
I20260806 02:17:20.078388 28797 leader_election.cc:288] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [CANDIDATE]: Term 1 election: Requested vote from peers 9c48367c7cc04a30bcfdeedd45f2e5e7 (127.26.189.131:34577), f97f4d9c29ab493589231f704523ad33 (127.26.189.129:45833)
I20260806 02:17:20.078651 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:20.073792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:60369 (local address 127.26.189.130:34833)
0806 02:17:20.074273 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:20.074278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:20.074293 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:17:20.074334 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:20.074337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:20.074397 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:20.074487 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:20.074805 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.075530 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.077369 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.077955 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.078023 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:20.078056 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:20.078459 (+ 403us) server_negotiation.cc:299] Negotiation successful
0806 02:17:20.078536 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407}
I20260806 02:17:20.079034 28803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:20.073161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:34833 (local address 127.26.189.129:60369)
0806 02:17:20.074110 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:20.074128 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:20.074248 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:20.074503 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:20.074506 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:20.074528 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:20.074644 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:20.074652 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.075666 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.075670 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:20.077229 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:20.077240 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.078190 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.078197 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:20.078297 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:20.078316 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 02:17:20.078797 (+ 481us) client_negotiation.cc:240] Negotiation successful
0806 02:17:20.078888 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"thread_start_us":158,"threads_started":1}
I20260806 02:17:20.079160 28781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:20.073677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:59409 (local address 127.26.189.131:34577)
0806 02:17:20.073831 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:20.073837 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:20.074885 (+ 1048us) server_negotiation.cc:407] Connection header received
0806 02:17:20.075050 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:20.075053 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:20.075093 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:20.075136 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:20.075586 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.076306 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.077839 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.078446 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.078568 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:20.078657 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:20.078978 (+ 321us) server_negotiation.cc:299] Negotiation successful
0806 02:17:20.079042 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 02:17:20.079221 28804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:20.073468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:34577 (local address 127.26.189.129:59409)
0806 02:17:20.074807 (+ 1339us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:20.074820 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:20.074945 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:20.075258 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:20.075260 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:20.075275 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:20.075375 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:20.075380 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.076481 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.076484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:20.077707 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:20.077717 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.078727 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.078730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:20.078853 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:20.078872 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 02:17:20.078961 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 02:17:20.079029 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1255,"thread_start_us":144,"threads_started":1}
I20260806 02:17:20.079262 28697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469341cabef444ad84136eed9cc3fedc" candidate_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7"
I20260806 02:17:20.079402 28697 raft_consensus.cc:3037] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:20.079808 28526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469341cabef444ad84136eed9cc3fedc" candidate_uuid: "f97f4d9c29ab493589231f704523ad33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" is_pre_election: true
I20260806 02:17:20.080122 28526 raft_consensus.cc:2379] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97f4d9c29ab493589231f704523ad33 in current term 1: Already voted for candidate 9e5f35e439ab4de9b4a0991a7bc3b82c in this term.
I20260806 02:17:20.080857 28697 raft_consensus.cc:2454] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e5f35e439ab4de9b4a0991a7bc3b82c in term 1.
I20260806 02:17:20.081137 28449 leader_election.cc:302] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c48367c7cc04a30bcfdeedd45f2e5e7, 9e5f35e439ab4de9b4a0991a7bc3b82c; no voters:
I20260806 02:17:20.081239 28697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469341cabef444ad84136eed9cc3fedc" candidate_uuid: "f97f4d9c29ab493589231f704523ad33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" is_pre_election: true
I20260806 02:17:20.081352 28797 raft_consensus.cc:2781] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:20.079035 28355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469341cabef444ad84136eed9cc3fedc" candidate_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97f4d9c29ab493589231f704523ad33"
I20260806 02:17:20.081434 28697 raft_consensus.cc:2379] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97f4d9c29ab493589231f704523ad33 in current term 1: Already voted for candidate 9e5f35e439ab4de9b4a0991a7bc3b82c in this term.
I20260806 02:17:20.081496 28355 raft_consensus.cc:3037] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:20.081631 28797 raft_consensus.cc:686] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [term 1 LEADER]: Becoming Leader. State: Replica: 9e5f35e439ab4de9b4a0991a7bc3b82c, State: Running, Role: LEADER
I20260806 02:17:20.082171 28797 consensus_queue.cc:237] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34577 } } peers { permanent_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 34833 } } peers { permanent_uuid: "f97f4d9c29ab493589231f704523ad33" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45833 } }
I20260806 02:17:20.082579 28355 raft_consensus.cc:2454] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e5f35e439ab4de9b4a0991a7bc3b82c in term 1.
I20260806 02:17:20.082975 28260 leader_election.cc:302] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97f4d9c29ab493589231f704523ad33; no voters: 9c48367c7cc04a30bcfdeedd45f2e5e7, 9e5f35e439ab4de9b4a0991a7bc3b82c
I20260806 02:17:20.083285 28799 raft_consensus.cc:2726] T 469341cabef444ad84136eed9cc3fedc P f97f4d9c29ab493589231f704523ad33 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 02:17:20.085872 28159 catalog_manager.cc:5495] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e5f35e439ab4de9b4a0991a7bc3b82c (127.26.189.130). New cstate: current_term: 1 leader_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c48367c7cc04a30bcfdeedd45f2e5e7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e5f35e439ab4de9b4a0991a7bc3b82c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 34833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97f4d9c29ab493589231f704523ad33" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45833 } health_report { overall_health: UNKNOWN } } }
Aug 06 02:17:20 dist-test-slave-gkw7 krb5kdc[28093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.129@KRBTEST.COM
I20260806 02:17:20.117883 28785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:20.108685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52298 (local address 127.26.189.129:45833)
0806 02:17:20.108901 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:20.108905 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:20.108992 (+ 87us) server_negotiation.cc:407] Connection header received
0806 02:17:20.109103 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:20.109105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:20.109150 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:20.109222 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:20.109953 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.110452 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.111258 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.111465 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.111539 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:20.114087 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:20.114102 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:20.114120 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:20.114146 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:20.116007 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:20.116484 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:20.116490 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:20.116492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:20.116591 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:20.116834 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:20.116836 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:20.116837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:20.117105 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:20.117280 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:20.117463 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 02:17:20.117666 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
Aug 06 02:17:20 dist-test-slave-gkw7 krb5kdc[28093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982640, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 02:17:20 dist-test-slave-gkw7 krb5kdc[28093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982640, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.189.129@KRBTEST.COM
I20260806 02:17:20.147541 28785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:20.138329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52310 (local address 127.26.189.129:45833)
0806 02:17:20.138505 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:20.138510 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:20.138642 (+ 132us) server_negotiation.cc:407] Connection header received
0806 02:17:20.138824 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:20.138827 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:20.138881 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:20.138975 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:20.139685 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.140220 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.141089 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.141331 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.141444 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:20.144118 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:20.144129 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:20.144131 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:20.144159 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:20.145716 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:20.146153 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:20.146157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:20.146159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:20.146256 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:20.146551 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:20.146559 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:20.146561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:20.146755 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:20.146925 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:20.147226 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 02:17:20.147372 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260806 02:17:20.156275 28764 tablet.cc:2369] T 469341cabef444ad84136eed9cc3fedc P 9c48367c7cc04a30bcfdeedd45f2e5e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 02:17:20 dist-test-slave-gkw7 krb5kdc[28093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 02:17:20 dist-test-slave-gkw7 krb5kdc[28093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.129@KRBTEST.COM
I20260806 02:17:20.177569 28785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:20.168790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52322 (local address 127.26.189.129:45833)
0806 02:17:20.168955 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:20.168960 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:20.169130 (+ 170us) server_negotiation.cc:407] Connection header received
0806 02:17:20.169223 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:20.169226 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:20.169286 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:20.169353 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:20.170088 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.170631 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.171477 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:20.171699 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:20.171792 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:20.174394 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:20.174397 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:20.174400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:20.174425 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:20.175810 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:20.176217 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:20.176220 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:20.176221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:20.176299 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:20.176533 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:20.176535 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:20.176536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:20.176702 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:20.176882 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:20.177154 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 02:17:20.177337 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260806 02:17:20.179710 28292 tablet_service.cc:2908] Rejecting scan request for tablet 469341cabef444ad84136eed9cc3fedc: Uninitialized: clean time has not yet been initialized
I20260806 02:17:20.182487 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 28238
W20260806 02:17:20.188076 28584 tablet.cc:2369] T 469341cabef444ad84136eed9cc3fedc P 9e5f35e439ab4de9b4a0991a7bc3b82c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:17:20.195607 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 28421
I20260806 02:17:20.205018 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 28590
I20260806 02:17:20.219878 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 28112
2026-08-06T02:17:20Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2678 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:20 dist-test-slave-gkw7 krb5kdc[28824](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:20 dist-test-slave-gkw7 krb5kdc[28824](info): set up 2 sockets
Aug 06 02:17:20 dist-test-slave-gkw7 krb5kdc[28824](info): commencing operation
krb5kdc: starting...
W20260806 02:17:21.447907 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:21 dist-test-slave-gkw7 krb5kdc[28824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:17:21.580976 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:37863
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:37863
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:21.696369 28840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:21.696659 28840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:21.696700 28840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:21.700839 28840 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:21.700908 28840 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 02:17:21.700927 28840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:21.700944 28840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:21.701004 28840 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:21.701032 28840 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:21.706665 28840 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:37863
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:37863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28840
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:21.707777 28840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:21.708840 28840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:21.717484 28855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:21.717494 28850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:21.717504 28849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:21.717749 28840 server_base.cc:1034] running on GCE node
I20260806 02:17:21.718449 28840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:21.719554 28840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:21.720728 28840 hybrid_clock.cc:648] HybridClock initialized: now 1785982641720701 us; error 40 us; skew 500 ppm
Aug 06 02:17:21 dist-test-slave-gkw7 krb5kdc[28824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982641, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:21.723765 28840 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:17:21.724678 28840 webserver.cc:460] Webserver started at http://127.26.189.190:42219/ using document root <none> and password file <none>
I20260806 02:17:21.725207 28840 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:21.725265 28840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:21.725436 28840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:21.727510 28840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "b06ae3c14c2e40c79d1d0f27118033ae"
format_stamp: "Formatted at 2026-08-06 02:17:21 on dist-test-slave-gkw7"
server_key: "aba483c32cd19b94341ca563baa36778"
server_key_iv: "6926bee1a447b6ca80f1c818a61f941f"
server_key_version: "encryptionkey@0"
I20260806 02:17:21.728035 28840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "b06ae3c14c2e40c79d1d0f27118033ae"
format_stamp: "Formatted at 2026-08-06 02:17:21 on dist-test-slave-gkw7"
server_key: "aba483c32cd19b94341ca563baa36778"
server_key_iv: "6926bee1a447b6ca80f1c818a61f941f"
server_key_version: "encryptionkey@0"
I20260806 02:17:21.731886 28840 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:21.734508 28864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:21.735790 28840 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 02:17:21.735939 28840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "b06ae3c14c2e40c79d1d0f27118033ae"
format_stamp: "Formatted at 2026-08-06 02:17:21 on dist-test-slave-gkw7"
server_key: "aba483c32cd19b94341ca563baa36778"
server_key_iv: "6926bee1a447b6ca80f1c818a61f941f"
server_key_version: "encryptionkey@0"
I20260806 02:17:21.736057 28840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:21.748476 28840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:21.751940 28840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:21.752146 28840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:21.760690 28840 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:37863
I20260806 02:17:21.760718 28950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:37863 every 8 connection(s)
I20260806 02:17:21.761747 28840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:21.765272 28952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:21.768239 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 28840
I20260806 02:17:21.768388 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:21.768684 27382 external_mini_cluster.cc:1428] Setting key 818ea9e906fbb1be1e368f4990894d52
I20260806 02:17:21.771761 28952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae: Bootstrap starting.
I20260806 02:17:21.774453 28952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:21.775315 28952 log.cc:824] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:21.777874 28952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae: No bootstrap required, opened a new log
Aug 06 02:17:21 dist-test-slave-gkw7 krb5kdc[28824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:21.781283 28952 raft_consensus.cc:348] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06ae3c14c2e40c79d1d0f27118033ae" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37863 } }
I20260806 02:17:21.781507 28952 raft_consensus.cc:374] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:21.781629 28952 raft_consensus.cc:729] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06ae3c14c2e40c79d1d0f27118033ae, State: Initialized, Role: FOLLOWER
I20260806 02:17:21.782119 28952 consensus_queue.cc:260] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06ae3c14c2e40c79d1d0f27118033ae" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37863 } }
I20260806 02:17:21.782279 28952 raft_consensus.cc:388] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:21.782351 28952 raft_consensus.cc:482] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:21.782480 28952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:21.783375 28952 raft_consensus.cc:504] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06ae3c14c2e40c79d1d0f27118033ae" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37863 } }
I20260806 02:17:21.783454 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:21.770193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45470 (local address 127.26.189.190:37863)
0806 02:17:21.770639 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:21.770654 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:21.770690 (+ 36us) server_negotiation.cc:407] Connection header received
0806 02:17:21.771306 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:21.771323 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:21.771647 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:21.771998 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:21.772873 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:21.773927 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:21.775108 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:21.775636 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:21.775823 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:21.778619 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:21.778624 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:21.778637 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:21.778663 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:21.780396 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:21.780858 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:21.780863 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:21.780867 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:21.780979 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:21.781282 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:21.781286 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:21.781288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:21.781840 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:21.782066 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:21.782322 (+ 256us) server_negotiation.cc:299] Negotiation successful
0806 02:17:21.782745 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":124,"threads_started":1}
I20260806 02:17:21.783768 28952 leader_election.cc:302] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b06ae3c14c2e40c79d1d0f27118033ae; no voters:
I20260806 02:17:21.784127 28952 leader_election.cc:288] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:21.784219 28959 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:21.784439 28959 raft_consensus.cc:686] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [term 1 LEADER]: Becoming Leader. State: Replica: b06ae3c14c2e40c79d1d0f27118033ae, State: Running, Role: LEADER
I20260806 02:17:21.784783 28959 consensus_queue.cc:237] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06ae3c14c2e40c79d1d0f27118033ae" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37863 } }
I20260806 02:17:21.785998 28959 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader b06ae3c14c2e40c79d1d0f27118033ae. Latest consensus state: current_term: 1 leader_uuid: "b06ae3c14c2e40c79d1d0f27118033ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06ae3c14c2e40c79d1d0f27118033ae" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37863 } } }
I20260806 02:17:21.786675 28952 sys_catalog.cc:564] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:21.786852 28959 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:21.787647 28964 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:21.786679 28960 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b06ae3c14c2e40c79d1d0f27118033ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06ae3c14c2e40c79d1d0f27118033ae" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37863 } } }
I20260806 02:17:21.788805 28960 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:21.790913 28964 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:21.797075 28964 catalog_manager.cc:1347] Generated new cluster ID: 53aa09a9dfef4a5b98f9379306a05bc7
I20260806 02:17:21.797148 28964 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:21.817698 28964 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:21.819032 28964 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:21.827173 28964 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae: Generated new TSK 0
I20260806 02:17:21.827989 28964 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:17:21.865576 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37863
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:21.997489 28985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:21.997814 28985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:21.997901 28985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:22.001959 28985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:22.002067 28985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:22.002149 28985 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 02:17:22.002245 28985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:22.007774 28985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.189.190:37863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:22.008880 28985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:22.009974 28985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:22.019805 28993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:22.019805 28997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:22.019840 28992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:22.020041 28985 server_base.cc:1034] running on GCE node
I20260806 02:17:22.020576 28985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:22.021276 28985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:22.022488 28985 hybrid_clock.cc:648] HybridClock initialized: now 1785982642022457 us; error 43 us; skew 500 ppm
Aug 06 02:17:22 dist-test-slave-gkw7 krb5kdc[28824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982642, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:22.025417 28985 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:17:22.026353 28985 webserver.cc:460] Webserver started at http://127.26.189.129:36463/ using document root <none> and password file <none>
I20260806 02:17:22.026942 28985 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:22.027042 28985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:22.027341 28985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:22.029458 28985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "a8d6d3f290be42dbabca745130ebb478"
format_stamp: "Formatted at 2026-08-06 02:17:22 on dist-test-slave-gkw7"
server_key: "0d4b58b94fed242b72f293e45a7ef82b"
server_key_iv: "4ea73a1cd522c8cd4394d6afef50d9fb"
server_key_version: "encryptionkey@0"
I20260806 02:17:22.030174 28985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "a8d6d3f290be42dbabca745130ebb478"
format_stamp: "Formatted at 2026-08-06 02:17:22 on dist-test-slave-gkw7"
server_key: "0d4b58b94fed242b72f293e45a7ef82b"
server_key_iv: "4ea73a1cd522c8cd4394d6afef50d9fb"
server_key_version: "encryptionkey@0"
I20260806 02:17:22.034224 28985 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 02:17:22.036713 29009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:22.038100 28985 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:17:22.038249 28985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "a8d6d3f290be42dbabca745130ebb478"
format_stamp: "Formatted at 2026-08-06 02:17:22 on dist-test-slave-gkw7"
server_key: "0d4b58b94fed242b72f293e45a7ef82b"
server_key_iv: "4ea73a1cd522c8cd4394d6afef50d9fb"
server_key_version: "encryptionkey@0"
I20260806 02:17:22.038370 28985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:22.056439 28985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:22.059580 28985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:22.059840 28985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:22.061369 28985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:22.061450 28985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:22.061544 28985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:22.061586 28985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 02:17:22 dist-test-slave-gkw7 krb5kdc[28824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982642, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:22.073550 28985 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:38493
I20260806 02:17:22.073606 29177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:38493 every 8 connection(s)
I20260806 02:17:22.074535 28985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:22.074712 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 28985
I20260806 02:17:22.074822 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:17:22.075178 27382 external_mini_cluster.cc:1428] Setting key 2761729365c70e0158d8b9ce7054d201
I20260806 02:17:22.076756 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.062389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:33537 (local address 127.26.189.190:37863)
0806 02:17:22.062515 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.062518 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.063621 (+ 1103us) server_negotiation.cc:407] Connection header received
0806 02:17:22.064912 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.064917 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.064987 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.065048 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:22.066796 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.067424 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.068762 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.069126 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.069248 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.072489 (+ 3241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:22.072492 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:22.072494 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:22.072519 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:22.074267 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.074952 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.074956 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.074958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.075061 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.075475 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.075481 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.075483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.075760 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:22.075864 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.076422 (+ 558us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.076576 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 02:17:22.077764 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.062949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37863 (local address 127.26.189.129:33537)
0806 02:17:22.063467 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.063511 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.064637 (+ 1126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.065507 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.065513 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.065939 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:22.066608 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.066624 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.067572 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.067576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.068614 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.068624 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.069310 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.069315 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.069493 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.070193 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:22.070219 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:22.072272 (+ 2053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:22.074436 (+ 2164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.074442 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.074457 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.074856 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.075175 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.075178 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.075180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.075358 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.075860 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:22.075866 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:22.076160 (+ 294us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.076373 (+ 213us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.076700 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":162,"threads_started":1}
I20260806 02:17:22.080060 29178 heartbeater.cc:347] Connected to a master server at 127.26.189.190:37863
I20260806 02:17:22.080224 29178 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:22.080739 29178 heartbeater.cc:511] Master 127.26.189.190:37863 requested a full tablet report, sending...
I20260806 02:17:22.082608 28884 ts_manager.cc:194] Registered new tserver with Master: a8d6d3f290be42dbabca745130ebb478 (127.26.189.129:38493)
I20260806 02:17:22.084131 28884 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:33537
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:17:22.091311 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.082958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:56473 (local address 127.26.189.190:37863)
0806 02:17:22.083119 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.083126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.083533 (+ 407us) server_negotiation.cc:407] Connection header received
0806 02:17:22.083661 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.083664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.083710 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.083794 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:22.084454 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.085185 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.086118 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.086471 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.086583 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.087890 (+ 1307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:22.087893 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:22.087896 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:22.087920 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:22.089660 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.090058 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.090060 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.090061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.090138 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.090460 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.090468 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.090469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.090634 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:22.090767 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.091016 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.091150 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 02:17:22.091321 29189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.083081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37863 (local address 127.26.189.129:56473)
0806 02:17:22.083421 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.083439 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.083557 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.083855 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.083860 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.084145 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:22.084313 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.084325 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.085331 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.085334 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.085992 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.086002 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.086589 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.086593 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.086694 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.087231 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:22.087243 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:22.087748 (+ 505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:22.089757 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.089760 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.089761 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.089956 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.090249 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.090253 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.090255 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.090352 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.090735 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:22.090739 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:22.090835 (+ 96us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.090953 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.091106 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":112,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:17:22.106933 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37863
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:22.223886 29193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:22.224190 29193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:22.224267 29193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:22.228209 29193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:22.228300 29193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:22.228374 29193 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 02:17:22.228461 29193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:22.233938 29193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.189.190:37863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:22.235095 29193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:22.236179 29193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:22.246157 29198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:22.246157 29202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:22.246188 29199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:22.246356 29193 server_base.cc:1034] running on GCE node
I20260806 02:17:22.246876 29193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:22.247545 29193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:22.248771 29193 hybrid_clock.cc:648] HybridClock initialized: now 1785982642248739 us; error 42 us; skew 500 ppm
Aug 06 02:17:22 dist-test-slave-gkw7 krb5kdc[28824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982642, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:22.251807 29193 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:17:22.252861 29193 webserver.cc:460] Webserver started at http://127.26.189.130:38323/ using document root <none> and password file <none>
I20260806 02:17:22.253669 29193 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:22.253796 29193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:22.254081 29193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:22.256456 29193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "9f929997fdec4d9587048a3db1b95dad"
format_stamp: "Formatted at 2026-08-06 02:17:22 on dist-test-slave-gkw7"
server_key: "246e87e2cf64514b27dffc658072c3e5"
server_key_iv: "3f766cd2a2f4c77befbdde571157a552"
server_key_version: "encryptionkey@0"
I20260806 02:17:22.257118 29193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "9f929997fdec4d9587048a3db1b95dad"
format_stamp: "Formatted at 2026-08-06 02:17:22 on dist-test-slave-gkw7"
server_key: "246e87e2cf64514b27dffc658072c3e5"
server_key_iv: "3f766cd2a2f4c77befbdde571157a552"
server_key_version: "encryptionkey@0"
I20260806 02:17:22.261344 29193 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:17:22.264165 29218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:22.265805 29193 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:22.265956 29193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "9f929997fdec4d9587048a3db1b95dad"
format_stamp: "Formatted at 2026-08-06 02:17:22 on dist-test-slave-gkw7"
server_key: "246e87e2cf64514b27dffc658072c3e5"
server_key_iv: "3f766cd2a2f4c77befbdde571157a552"
server_key_version: "encryptionkey@0"
I20260806 02:17:22.266088 29193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:22.279950 29193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:22.285732 29193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:22.285961 29193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:22.287911 29193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:22.287986 29193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:22.288054 29193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:22.288089 29193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 02:17:22 dist-test-slave-gkw7 krb5kdc[28824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982642, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:22.301841 29193 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:44947
I20260806 02:17:22.301888 29378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:44947 every 8 connection(s)
I20260806 02:17:22.303131 29193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:22.304720 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 29193
I20260806 02:17:22.304865 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:17:22.305213 27382 external_mini_cluster.cc:1428] Setting key 0e44adc8e54e7b610df5d64faa58e9cf
I20260806 02:17:22.308202 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.289850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:34347 (local address 127.26.189.190:37863)
0806 02:17:22.290043 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.290051 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.290890 (+ 839us) server_negotiation.cc:407] Connection header received
0806 02:17:22.292439 (+ 1549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.292442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.292514 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.292607 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:22.294799 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.295923 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.298230 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.298627 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.298712 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.302652 (+ 3940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:22.302660 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:22.302665 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:22.302707 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:22.305222 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.305966 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.305970 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.305972 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.306102 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.307003 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.307006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.307008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.307252 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:22.307355 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.307894 (+ 539us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.308033 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 02:17:22.309216 29231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.290140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37863 (local address 127.26.189.130:34347)
0806 02:17:22.290708 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.290783 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.292127 (+ 1344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.292990 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.293002 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.293646 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:22.294577 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.294601 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.296140 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.296143 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.298056 (+ 1913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.298072 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.298950 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.298958 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.299233 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.299972 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:22.299990 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:22.302384 (+ 2394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:22.305402 (+ 3018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.305409 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.305427 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.305848 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.306295 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.306301 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.306303 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.306542 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.307357 (+ 815us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:22.307366 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:22.307639 (+ 273us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.307836 (+ 197us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.308182 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":139,"threads_started":1}
I20260806 02:17:22.313608 29379 heartbeater.cc:347] Connected to a master server at 127.26.189.190:37863
I20260806 02:17:22.313791 29379 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:22.314745 29379 heartbeater.cc:511] Master 127.26.189.190:37863 requested a full tablet report, sending...
I20260806 02:17:22.315995 28885 ts_manager.cc:194] Registered new tserver with Master: 9f929997fdec4d9587048a3db1b95dad (127.26.189.130:44947)
I20260806 02:17:22.316835 28885 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:34347
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
I20260806 02:17:22.324683 29390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.316041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37863 (local address 127.26.189.130:50737)
0806 02:17:22.316364 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.316379 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.316470 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.317026 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.317032 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.317323 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:22.317502 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.317515 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.318578 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.318584 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.319726 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.319742 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.320222 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.320226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.320340 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.320878 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:22.320896 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:22.321255 (+ 359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:22.323006 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.323009 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.323010 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.323276 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.323574 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.323580 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.323586 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.323706 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.324230 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:22.324233 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:22.324319 (+ 86us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.324410 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.324524 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":2,"thread_start_us":124,"threads_started":1}
I20260806 02:17:22.324858 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.316476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:50737 (local address 127.26.189.190:37863)
0806 02:17:22.316623 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.316630 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.316648 (+ 18us) server_negotiation.cc:407] Connection header received
0806 02:17:22.316697 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.316702 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.316764 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.316864 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:22.317657 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.318407 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.319883 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.320095 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.320171 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.321387 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:22.321390 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:22.321392 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:22.321440 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:22.322903 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.323377 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.323380 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.323381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.323494 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.323820 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.323823 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.323825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.324124 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:22.324233 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.324497 (+ 264us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.324637 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:17:22.340770 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37863
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:22.455879 29392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:22.456130 29392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:22.456176 29392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:22.460021 29392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:22.460070 29392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:22.460107 29392 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 02:17:22.460139 29392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:22.465368 29392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.189.190:37863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:22.466454 29392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:22.467485 29392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:22.477288 29403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:22.477294 29409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:22.477219 29406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:22.477470 29392 server_base.cc:1034] running on GCE node
I20260806 02:17:22.477967 29392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:22.478621 29392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:22.479820 29392 hybrid_clock.cc:648] HybridClock initialized: now 1785982642479784 us; error 47 us; skew 500 ppm
Aug 06 02:17:22 dist-test-slave-gkw7 krb5kdc[28824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982642, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:22.483001 29392 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:17:22.483927 29392 webserver.cc:460] Webserver started at http://127.26.189.131:38041/ using document root <none> and password file <none>
I20260806 02:17:22.484536 29392 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:22.484632 29392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:22.484887 29392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:22.487241 29392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "86721241503447f0a7486bd8076e167f"
format_stamp: "Formatted at 2026-08-06 02:17:22 on dist-test-slave-gkw7"
server_key: "e85cee37230a7503cd8b23f60a19382f"
server_key_iv: "9dec29532b9af5993df68195081ae959"
server_key_version: "encryptionkey@0"
I20260806 02:17:22.487854 29392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "86721241503447f0a7486bd8076e167f"
format_stamp: "Formatted at 2026-08-06 02:17:22 on dist-test-slave-gkw7"
server_key: "e85cee37230a7503cd8b23f60a19382f"
server_key_iv: "9dec29532b9af5993df68195081ae959"
server_key_version: "encryptionkey@0"
I20260806 02:17:22.492476 29392 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260806 02:17:22.495203 29418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:22.496554 29392 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 02:17:22.496726 29392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "86721241503447f0a7486bd8076e167f"
format_stamp: "Formatted at 2026-08-06 02:17:22 on dist-test-slave-gkw7"
server_key: "e85cee37230a7503cd8b23f60a19382f"
server_key_iv: "9dec29532b9af5993df68195081ae959"
server_key_version: "encryptionkey@0"
I20260806 02:17:22.496862 29392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:22.506546 29392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:22.509949 29392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:22.510164 29392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:22.511654 29392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:22.511732 29392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:22.511808 29392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:22.511853 29392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 02:17:22 dist-test-slave-gkw7 krb5kdc[28824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982642, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:22.523063 29392 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:44549
I20260806 02:17:22.523186 29579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:44549 every 8 connection(s)
I20260806 02:17:22.524163 29392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:22.527488 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.512589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:55629 (local address 127.26.189.190:37863)
0806 02:17:22.512721 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.512724 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.513948 (+ 1224us) server_negotiation.cc:407] Connection header received
0806 02:17:22.515220 (+ 1272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.515223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.515284 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.515392 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:22.517026 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.517983 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.519869 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.520163 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.520294 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.523439 (+ 3145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:22.523443 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:22.523445 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:22.523471 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:22.525246 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.525946 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.525948 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.525950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.526031 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.526426 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.526428 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.526429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.526639 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:22.526716 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.527210 (+ 494us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.527328 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 02:17:22.527976 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 29392
I20260806 02:17:22.528141 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:17:22.528384 29430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.513230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37863 (local address 127.26.189.131:55629)
0806 02:17:22.513798 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.513842 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.514974 (+ 1132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.515569 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.515580 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.516077 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:22.516788 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.516815 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.518138 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.518143 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.519746 (+ 1603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.519760 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.520343 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.520347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.520538 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.521195 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:22.521217 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:22.523213 (+ 1996us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:22.525424 (+ 2211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.525429 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.525441 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.525842 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.526145 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.526148 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.526149 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.526318 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.526733 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:22.526738 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:22.526971 (+ 233us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.527125 (+ 154us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.527410 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":142,"threads_started":1}
I20260806 02:17:22.528424 27382 external_mini_cluster.cc:1428] Setting key c276c41d09205f29e7a109dc20331205
I20260806 02:17:22.530403 29580 heartbeater.cc:347] Connected to a master server at 127.26.189.190:37863
I20260806 02:17:22.530560 29580 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:22.531090 29580 heartbeater.cc:511] Master 127.26.189.190:37863 requested a full tablet report, sending...
I20260806 02:17:22.532198 28881 ts_manager.cc:194] Registered new tserver with Master: 86721241503447f0a7486bd8076e167f (127.26.189.131:44549)
I20260806 02:17:22.532846 28881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:55629
I20260806 02:17:22.539132 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.531973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:36959 (local address 127.26.189.190:37863)
0806 02:17:22.532108 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.532113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.532331 (+ 218us) server_negotiation.cc:407] Connection header received
0806 02:17:22.532428 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.532431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.532472 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.532561 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:22.533013 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.533666 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.534500 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.534744 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.534854 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.535988 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:22.535992 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:22.535995 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:22.536018 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:22.537460 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.537928 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.537933 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.537934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.538015 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.538298 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.538303 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.538305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.538483 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:22.538599 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.538857 (+ 258us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.538967 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 02:17:22.539148 29589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.531894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37863 (local address 127.26.189.131:36959)
0806 02:17:22.532214 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.532226 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.532339 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.532587 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.532590 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.532793 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:22.532891 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.532897 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.533792 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.533795 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.534379 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.534387 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.534860 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.534863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.534962 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.535507 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:22.535519 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:22.535845 (+ 326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:22.537618 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.537622 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.537624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.537828 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.538114 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.538116 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.538118 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.538205 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.538581 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:22.538584 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:22.538679 (+ 95us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.538791 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.538943 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":117,"threads_started":1}
I20260806 02:17:22.542565 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 02:17:22 dist-test-slave-gkw7 krb5kdc[28824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982642, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 02:17:22 dist-test-slave-gkw7 krb5kdc[28824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982642, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:22.571368 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.562191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45484 (local address 127.26.189.190:37863)
0806 02:17:22.562331 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.562335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.562350 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:17:22.562394 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.562396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.562437 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.562513 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:22.563247 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.563779 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.564578 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.564804 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.564887 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.567528 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:22.567532 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:22.567534 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:22.567563 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:22.569253 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.569690 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.569694 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.569695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.569841 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.570380 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.570383 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.570384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.570606 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:22.570725 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.571105 (+ 380us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.571230 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 02:17:22.574875 28881 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45484:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:17:22.578203 28881 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:22.594204 29608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.587486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:44947 (local address 127.0.0.1:44430)
0806 02:17:22.588384 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.588439 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.588656 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.589442 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.589444 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.589463 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:22.589595 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.589602 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.591009 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.591012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.592489 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.592500 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.593633 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.593637 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.593750 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.593794 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.593917 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.594040 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":1,"thread_start_us":106,"threads_started":1}
I20260806 02:17:22.594255 29609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.587628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44430 (local address 127.26.189.130:44947)
0806 02:17:22.588063 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.588074 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.588536 (+ 462us) server_negotiation.cc:407] Connection header received
0806 02:17:22.588856 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.588863 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.589092 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.589243 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:22.589715 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.590875 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.592627 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.593404 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.593576 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.593735 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.593975 (+ 240us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.594087 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":113,"threads_started":1}
I20260806 02:17:22.595065 29612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.588667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38493 (local address 127.0.0.1:42898)
0806 02:17:22.589705 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.589717 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.589797 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.590234 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.590237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.590255 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:22.590352 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.590362 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.591542 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.591546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.593355 (+ 1809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.593363 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.594671 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.594674 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.594776 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.594799 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.594869 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.594936 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":970,"mutex_wait_us":908,"thread_start_us":104,"threads_started":1}
I20260806 02:17:22.595309 29610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.587694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:44549 (local address 127.0.0.1:40516)
0806 02:17:22.588626 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.588639 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.588747 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.589282 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.589288 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.589315 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:22.589471 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.589478 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.591750 (+ 2272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.591753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.592842 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.592851 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.594890 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.594893 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.594986 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.595009 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.595088 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.595178 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":874,"thread_start_us":122,"threads_started":1}
I20260806 02:17:22.595589 29614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.589099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42898 (local address 127.26.189.129:38493)
0806 02:17:22.589852 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.589865 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.589885 (+ 20us) server_negotiation.cc:407] Connection header received
0806 02:17:22.589945 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.589949 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.590089 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.590243 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:22.590489 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.591397 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.593486 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.594337 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.594467 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.594606 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.595355 (+ 749us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.595460 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":102,"threads_started":1}
I20260806 02:17:22.596031 29611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.587886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40516 (local address 127.26.189.131:44549)
0806 02:17:22.588481 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.588496 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.588868 (+ 372us) server_negotiation.cc:407] Connection header received
0806 02:17:22.588942 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.588947 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.589091 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.589243 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:22.589635 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.590874 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.592974 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.593838 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.594011 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.594132 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.595795 (+ 1663us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.595907 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":94,"threads_started":1}
I20260806 02:17:22.597801 29280 tablet_service.cc:1467] Processing CreateTablet for tablet 794636556d224ab593690d2f049e421c (DEFAULT_TABLE table=test-table [id=df583c6640d54f44a5540c751c67ad46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:22.598027 29074 tablet_service.cc:1467] Processing CreateTablet for tablet 794636556d224ab593690d2f049e421c (DEFAULT_TABLE table=test-table [id=df583c6640d54f44a5540c751c67ad46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:22.599009 29280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 794636556d224ab593690d2f049e421c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:22.599011 29074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 794636556d224ab593690d2f049e421c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:22.598750 29488 tablet_service.cc:1467] Processing CreateTablet for tablet 794636556d224ab593690d2f049e421c (DEFAULT_TABLE table=test-table [id=df583c6640d54f44a5540c751c67ad46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:22.599686 29488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 794636556d224ab593690d2f049e421c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:22.605482 29615 tablet_bootstrap.cc:492] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478: Bootstrap starting.
I20260806 02:17:22.608001 29621 tablet_bootstrap.cc:492] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad: Bootstrap starting.
I20260806 02:17:22.608584 29615 tablet_bootstrap.cc:654] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:22.609385 29615 log.cc:824] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:22.609992 29621 tablet_bootstrap.cc:654] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:22.610088 29618 tablet_bootstrap.cc:492] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f: Bootstrap starting.
I20260806 02:17:22.610698 29621 log.cc:824] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:22.611868 29618 tablet_bootstrap.cc:654] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:22.612751 29621 tablet_bootstrap.cc:492] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad: No bootstrap required, opened a new log
I20260806 02:17:22.612975 29621 ts_tablet_manager.cc:1397] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 02:17:22.612639 29618 log.cc:824] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:22.614200 29615 tablet_bootstrap.cc:492] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478: No bootstrap required, opened a new log
I20260806 02:17:22.614429 29615 ts_tablet_manager.cc:1397] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260806 02:17:22.615700 29618 tablet_bootstrap.cc:492] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f: No bootstrap required, opened a new log
I20260806 02:17:22.615945 29618 ts_tablet_manager.cc:1397] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260806 02:17:22.616565 29621 raft_consensus.cc:348] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } }
I20260806 02:17:22.616852 29621 raft_consensus.cc:374] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:22.616909 29621 raft_consensus.cc:729] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f929997fdec4d9587048a3db1b95dad, State: Initialized, Role: FOLLOWER
I20260806 02:17:22.617398 29621 consensus_queue.cc:260] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } }
I20260806 02:17:22.618124 29379 heartbeater.cc:503] Master 127.26.189.190:37863 was elected leader, sending a full tablet report...
I20260806 02:17:22.618526 29621 ts_tablet_manager.cc:1428] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 02:17:22.619606 29615 raft_consensus.cc:348] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } }
I20260806 02:17:22.619904 29615 raft_consensus.cc:374] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:22.619966 29615 raft_consensus.cc:729] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8d6d3f290be42dbabca745130ebb478, State: Initialized, Role: FOLLOWER
I20260806 02:17:22.620206 29618 raft_consensus.cc:348] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } }
I20260806 02:17:22.620463 29618 raft_consensus.cc:374] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:22.620515 29618 raft_consensus.cc:729] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86721241503447f0a7486bd8076e167f, State: Initialized, Role: FOLLOWER
I20260806 02:17:22.620443 29615 consensus_queue.cc:260] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } }
I20260806 02:17:22.620994 29618 consensus_queue.cc:260] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } }
I20260806 02:17:22.621511 29615 ts_tablet_manager.cc:1428] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 02:17:22.621891 29580 heartbeater.cc:503] Master 127.26.189.190:37863 was elected leader, sending a full tablet report...
I20260806 02:17:22.621901 29178 heartbeater.cc:503] Master 127.26.189.190:37863 was elected leader, sending a full tablet report...
I20260806 02:17:22.622018 29618 ts_tablet_manager.cc:1428] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 02:17:22.740159 29626 raft_consensus.cc:482] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:22.740473 29626 raft_consensus.cc:504] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } }
I20260806 02:17:22.741905 29626 leader_election.cc:288] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86721241503447f0a7486bd8076e167f (127.26.189.131:44549), a8d6d3f290be42dbabca745130ebb478 (127.26.189.129:38493)
I20260806 02:17:22.746917 29231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.742142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:44549 (local address 127.26.189.130:45427)
0806 02:17:22.742365 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.742383 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.742513 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.742877 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.742879 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.742900 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:22.743045 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.743053 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.744186 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.744190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.745695 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.745707 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.746451 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.746453 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.746543 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.746565 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.746673 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.746749 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260806 02:17:22.746909 29611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.742278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:45427 (local address 127.26.189.131:44549)
0806 02:17:22.742431 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.742436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.742454 (+ 18us) server_negotiation.cc:407] Connection header received
0806 02:17:22.742651 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.742654 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.742736 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.742832 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:22.743169 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.744011 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.745819 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.746324 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.746444 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.746497 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.746692 (+ 195us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.746775 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 02:17:22.747404 29614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.742358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:44701 (local address 127.26.189.129:38493)
0806 02:17:22.742614 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.742619 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.742739 (+ 120us) server_negotiation.cc:407] Connection header received
0806 02:17:22.742800 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.742804 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.742877 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.742962 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:22.743295 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.744040 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.746127 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.746713 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.746840 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.746885 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.747176 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.747271 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260806 02:17:22.747651 29519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "794636556d224ab593690d2f049e421c" candidate_uuid: "9f929997fdec4d9587048a3db1b95dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86721241503447f0a7486bd8076e167f" is_pre_election: true
I20260806 02:17:22.747803 29631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.742216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38493 (local address 127.26.189.130:44701)
0806 02:17:22.742627 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.742640 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.742729 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.742985 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.742988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.743004 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:22.743177 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.743186 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.744194 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.744196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.746006 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.746014 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.746840 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.746844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.746949 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.746978 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.747554 (+ 576us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.747631 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":4,"thread_start_us":130,"threads_started":1}
I20260806 02:17:22.747802 29628 raft_consensus.cc:482] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:22.747994 29519 raft_consensus.cc:2454] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f929997fdec4d9587048a3db1b95dad in term 0.
I20260806 02:17:22.747990 29628 raft_consensus.cc:504] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } }
I20260806 02:17:22.748382 29108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "794636556d224ab593690d2f049e421c" candidate_uuid: "9f929997fdec4d9587048a3db1b95dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8d6d3f290be42dbabca745130ebb478" is_pre_election: true
I20260806 02:17:22.748567 29108 raft_consensus.cc:2454] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f929997fdec4d9587048a3db1b95dad in term 0.
I20260806 02:17:22.748589 29220 leader_election.cc:302] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86721241503447f0a7486bd8076e167f, 9f929997fdec4d9587048a3db1b95dad; no voters:
I20260806 02:17:22.748921 29626 raft_consensus.cc:2781] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:22.749018 29626 raft_consensus.cc:482] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:22.749074 29626 raft_consensus.cc:3037] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:22.749297 29628 leader_election.cc:288] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f929997fdec4d9587048a3db1b95dad (127.26.189.130:44947), 86721241503447f0a7486bd8076e167f (127.26.189.131:44549)
I20260806 02:17:22.750660 29626 raft_consensus.cc:504] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } }
I20260806 02:17:22.751109 29626 leader_election.cc:288] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [CANDIDATE]: Term 1 election: Requested vote from peers 86721241503447f0a7486bd8076e167f (127.26.189.131:44549), a8d6d3f290be42dbabca745130ebb478 (127.26.189.129:38493)
I20260806 02:17:22.751422 29108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "794636556d224ab593690d2f049e421c" candidate_uuid: "9f929997fdec4d9587048a3db1b95dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8d6d3f290be42dbabca745130ebb478"
I20260806 02:17:22.751431 29519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "794636556d224ab593690d2f049e421c" candidate_uuid: "9f929997fdec4d9587048a3db1b95dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86721241503447f0a7486bd8076e167f"
I20260806 02:17:22.751556 29108 raft_consensus.cc:3037] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:22.751573 29519 raft_consensus.cc:3037] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:22.752624 29108 raft_consensus.cc:2454] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f929997fdec4d9587048a3db1b95dad in term 1.
I20260806 02:17:22.753002 29222 leader_election.cc:302] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f929997fdec4d9587048a3db1b95dad, a8d6d3f290be42dbabca745130ebb478; no voters:
I20260806 02:17:22.753219 29519 raft_consensus.cc:2454] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f929997fdec4d9587048a3db1b95dad in term 1.
I20260806 02:17:22.753361 29626 raft_consensus.cc:2781] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:22.753623 29626 raft_consensus.cc:686] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 1 LEADER]: Becoming Leader. State: Replica: 9f929997fdec4d9587048a3db1b95dad, State: Running, Role: LEADER
I20260806 02:17:22.753985 29626 consensus_queue.cc:237] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } }
I20260806 02:17:22.754308 29609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.749903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:53761 (local address 127.26.189.130:44947)
0806 02:17:22.750027 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.750032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.750047 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:17:22.750149 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.750155 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.750203 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.750278 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:22.750617 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.751457 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.753150 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.753745 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.753819 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.753852 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.754147 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.754212 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 02:17:22.754333 29634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.749429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:44947 (local address 127.26.189.129:53761)
0806 02:17:22.749951 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.749965 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.750057 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.750334 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.750337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.750358 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:22.750485 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.750495 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.751650 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.751654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.752990 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.753001 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.753931 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.753933 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.754007 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.754023 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.754112 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.754187 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":245,"threads_started":1}
I20260806 02:17:22.754812 29311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "794636556d224ab593690d2f049e421c" candidate_uuid: "a8d6d3f290be42dbabca745130ebb478" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f929997fdec4d9587048a3db1b95dad" is_pre_election: true
I20260806 02:17:22.757014 29611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.749684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:44257 (local address 127.26.189.131:44549)
0806 02:17:22.749808 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.749812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.750181 (+ 369us) server_negotiation.cc:407] Connection header received
0806 02:17:22.750342 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.750346 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.750387 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.750476 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:22.750890 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.753321 (+ 2431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.754728 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.755284 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.755374 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.755416 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.756844 (+ 1428us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.756913 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 02:17:22.757032 29632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.749565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:44549 (local address 127.26.189.129:44257)
0806 02:17:22.750094 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.750108 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.750208 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.750607 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.750610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.750627 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:22.750748 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.750756 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.753479 (+ 2723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.753483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.754573 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.754584 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.756538 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.756548 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.756672 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.756696 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.756824 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.756892 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":117,"threads_started":1}
I20260806 02:17:22.757557 29519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "794636556d224ab593690d2f049e421c" candidate_uuid: "a8d6d3f290be42dbabca745130ebb478" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86721241503447f0a7486bd8076e167f" is_pre_election: true
I20260806 02:17:22.757740 29519 raft_consensus.cc:2379] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8d6d3f290be42dbabca745130ebb478 in current term 1: Already voted for candidate 9f929997fdec4d9587048a3db1b95dad in this term.
I20260806 02:17:22.757491 28884 catalog_manager.cc:5495] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f929997fdec4d9587048a3db1b95dad (127.26.189.130). New cstate: current_term: 1 leader_uuid: "9f929997fdec4d9587048a3db1b95dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20260806 02:17:22.758172 29012 leader_election.cc:302] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8d6d3f290be42dbabca745130ebb478; no voters: 86721241503447f0a7486bd8076e167f, 9f929997fdec4d9587048a3db1b95dad
I20260806 02:17:22.758456 29628 raft_consensus.cc:2726] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260806 02:17:22.775233 29583 tablet.cc:2369] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:17:22.797053 29609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.793631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44446 (local address 127.26.189.130:44947)
0806 02:17:22.793782 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.793786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.793801 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:17:22.793949 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.793951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.794006 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.794094 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:22.794343 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.794852 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.795674 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.795882 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.795959 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.796239 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:22.796654 (+ 415us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:22.796741 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.796828 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.796876 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 02:17:22.803633 29108 raft_consensus.cc:1261] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [term 1 FOLLOWER]: Refusing update from remote peer 9f929997fdec4d9587048a3db1b95dad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260806 02:17:22.804419 29381 tablet.cc:2369] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:17:22.804426 29635 consensus_queue.cc:1035] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:22.805256 29519 raft_consensus.cc:1261] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f [term 1 FOLLOWER]: Refusing update from remote peer 9f929997fdec4d9587048a3db1b95dad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:22.805861 29635 consensus_queue.cc:1035] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:22.813628 29641 mvcc.cc:205] Tried to move back new op lower bound from 7315384904914927616 to 7315384904723206144. Current Snapshot: MvccSnapshot[applied={T|T < 7315384904914927616}]
I20260806 02:17:22.814105 29640 mvcc.cc:205] Tried to move back new op lower bound from 7315384904914927616 to 7315384904723206144. Current Snapshot: MvccSnapshot[applied={T|T < 7315384904914927616}]
I20260806 02:17:22.825831 28884 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:22.826093 28884 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:22.828933 28884 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae: Sending DeleteTablet for 3 replicas of tablet 794636556d224ab593690d2f049e421c
I20260806 02:17:22.829777 29280 tablet_service.cc:1514] Processing DeleteTablet for tablet 794636556d224ab593690d2f049e421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:22 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:44430
I20260806 02:17:22.829856 29488 tablet_service.cc:1514] Processing DeleteTablet for tablet 794636556d224ab593690d2f049e421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:22 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:40516
I20260806 02:17:22.830268 29655 tablet_replica.cc:330] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad: stopping tablet replica
I20260806 02:17:22.830674 29656 tablet_replica.cc:330] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f: stopping tablet replica
I20260806 02:17:22.830647 29074 tablet_service.cc:1514] Processing DeleteTablet for tablet 794636556d224ab593690d2f049e421c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:22 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:42898
I20260806 02:17:22.830677 29655 raft_consensus.cc:2229] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:17:22.830956 29656 raft_consensus.cc:2229] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:22.831244 29655 raft_consensus.cc:2258] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:22.831274 29656 raft_consensus.cc:2258] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:22.831635 29657 tablet_replica.cc:330] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478: stopping tablet replica
I20260806 02:17:22.831777 28884 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45484:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 02:17:22.831918 29657 raft_consensus.cc:2229] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260806 02:17:22.832199 28884 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:22.832216 29657 raft_consensus.cc:2258] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:22.834113 29656 ts_tablet_manager.cc:1905] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:22.834784 29657 ts_tablet_manager.cc:1905] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:22.837456 29656 ts_tablet_manager.cc:1918] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:22.837658 29656 log.cc:1196] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/794636556d224ab593690d2f049e421c
I20260806 02:17:22.838119 29656 ts_tablet_manager.cc:1939] T 794636556d224ab593690d2f049e421c P 86721241503447f0a7486bd8076e167f: Deleting consensus metadata
I20260806 02:17:22.838071 29280 tablet_service.cc:1467] Processing CreateTablet for tablet a0c98daf7b724076a5b2acb49d85eadc (DEFAULT_TABLE table=test-table [id=6b77b5ac4e0945dab3dd29bd5eb36937]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:22.838374 29280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0c98daf7b724076a5b2acb49d85eadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:22.838356 29657 ts_tablet_manager.cc:1918] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:22.838466 29657 log.cc:1196] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/wal/wals/794636556d224ab593690d2f049e421c
I20260806 02:17:22.838780 29657 ts_tablet_manager.cc:1939] T 794636556d224ab593690d2f049e421c P a8d6d3f290be42dbabca745130ebb478: Deleting consensus metadata
I20260806 02:17:22.839859 29655 ts_tablet_manager.cc:1905] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:22.840888 29621 tablet_bootstrap.cc:492] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad: Bootstrap starting.
I20260806 02:17:22.841151 29074 tablet_service.cc:1467] Processing CreateTablet for tablet a0c98daf7b724076a5b2acb49d85eadc (DEFAULT_TABLE table=test-table [id=6b77b5ac4e0945dab3dd29bd5eb36937]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:22.841392 29074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0c98daf7b724076a5b2acb49d85eadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:22.841941 29621 tablet_bootstrap.cc:654] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:22.842238 29655 ts_tablet_manager.cc:1918] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:22.842326 29655 log.cc:1196] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/794636556d224ab593690d2f049e421c
I20260806 02:17:22.842656 29655 ts_tablet_manager.cc:1939] T 794636556d224ab593690d2f049e421c P 9f929997fdec4d9587048a3db1b95dad: Deleting consensus metadata
I20260806 02:17:22.843353 29621 tablet_bootstrap.cc:492] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad: No bootstrap required, opened a new log
I20260806 02:17:22.843436 29621 ts_tablet_manager.cc:1397] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 02:17:22.843645 29615 tablet_bootstrap.cc:492] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478: Bootstrap starting.
I20260806 02:17:22.843840 29621 raft_consensus.cc:348] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.843925 29621 raft_consensus.cc:374] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:22.843945 29621 raft_consensus.cc:729] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f929997fdec4d9587048a3db1b95dad, State: Initialized, Role: FOLLOWER
I20260806 02:17:22.844019 29621 consensus_queue.cc:260] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.844115 29488 tablet_service.cc:1467] Processing CreateTablet for tablet a0c98daf7b724076a5b2acb49d85eadc (DEFAULT_TABLE table=test-table [id=6b77b5ac4e0945dab3dd29bd5eb36937]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:22.844280 29621 ts_tablet_manager.cc:1428] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:22.844365 29488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0c98daf7b724076a5b2acb49d85eadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:22.844641 29615 tablet_bootstrap.cc:654] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:22.846035 29615 tablet_bootstrap.cc:492] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478: No bootstrap required, opened a new log
I20260806 02:17:22.846141 29615 ts_tablet_manager.cc:1397] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 02:17:22.846539 29615 raft_consensus.cc:348] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.846658 29615 raft_consensus.cc:374] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:22.846699 29615 raft_consensus.cc:729] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8d6d3f290be42dbabca745130ebb478, State: Initialized, Role: FOLLOWER
I20260806 02:17:22.846838 29615 consensus_queue.cc:260] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.846887 29618 tablet_bootstrap.cc:492] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f: Bootstrap starting.
I20260806 02:17:22.847105 29615 ts_tablet_manager.cc:1428] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:22.847807 29618 tablet_bootstrap.cc:654] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:22.848471 28869 catalog_manager.cc:4841] TS a8d6d3f290be42dbabca745130ebb478 (127.26.189.129:38493): tablet 794636556d224ab593690d2f049e421c (table test-table [id=df583c6640d54f44a5540c751c67ad46]) successfully deleted
I20260806 02:17:22.848875 28866 catalog_manager.cc:4841] TS 86721241503447f0a7486bd8076e167f (127.26.189.131:44549): tablet 794636556d224ab593690d2f049e421c (table test-table [id=df583c6640d54f44a5540c751c67ad46]) successfully deleted
I20260806 02:17:22.849313 28865 catalog_manager.cc:4841] TS 9f929997fdec4d9587048a3db1b95dad (127.26.189.130:44947): tablet 794636556d224ab593690d2f049e421c (table test-table [id=df583c6640d54f44a5540c751c67ad46]) successfully deleted
I20260806 02:17:22.849956 29618 tablet_bootstrap.cc:492] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f: No bootstrap required, opened a new log
I20260806 02:17:22.850054 29618 ts_tablet_manager.cc:1397] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 02:17:22.850476 29618 raft_consensus.cc:348] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.850566 29618 raft_consensus.cc:374] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:22.850637 29618 raft_consensus.cc:729] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86721241503447f0a7486bd8076e167f, State: Initialized, Role: FOLLOWER
I20260806 02:17:22.850776 29618 consensus_queue.cc:260] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.851028 29618 ts_tablet_manager.cc:1428] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 02:17:22.928097 29629 raft_consensus.cc:482] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:22.928272 29629 raft_consensus.cc:504] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.929504 29629 leader_election.cc:288] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8d6d3f290be42dbabca745130ebb478 (127.26.189.129:38493), 9f929997fdec4d9587048a3db1b95dad (127.26.189.130:44947)
I20260806 02:17:22.934530 29661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.929858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:44947 (local address 127.26.189.131:32817)
0806 02:17:22.930269 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.930284 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.930393 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.930717 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.930720 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.930735 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:22.930912 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.930919 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.931975 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.931978 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.933087 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.933097 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.934040 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.934045 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.934144 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.934174 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.934269 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.934351 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":1,"thread_start_us":111,"threads_started":1}
I20260806 02:17:22.934536 29609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.930250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:32817 (local address 127.26.189.130:44947)
0806 02:17:22.930405 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.930411 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.930446 (+ 35us) server_negotiation.cc:407] Connection header received
0806 02:17:22.930496 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.930500 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.930549 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.930615 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:22.931039 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.931817 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.933230 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.933879 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.934020 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.934084 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.934311 (+ 227us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.934413 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 02:17:22.934868 29614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.930051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:53633 (local address 127.26.189.129:38493)
0806 02:17:22.930195 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.930200 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.930217 (+ 17us) server_negotiation.cc:407] Connection header received
0806 02:17:22.930281 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.930284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.930338 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.930418 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:22.930862 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.931709 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.933323 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.933965 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.934067 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.934122 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.934656 (+ 534us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.934761 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 02:17:22.934578 29430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.929735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38493 (local address 127.26.189.131:53633)
0806 02:17:22.929900 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.929917 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.930023 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.930546 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.930549 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.930571 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:22.930704 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.930712 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.931877 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.931881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.933175 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.933187 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.934162 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.934165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.934303 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.934327 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.934401 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.934467 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":56}
I20260806 02:17:22.935209 29311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0c98daf7b724076a5b2acb49d85eadc" candidate_uuid: "86721241503447f0a7486bd8076e167f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f929997fdec4d9587048a3db1b95dad" is_pre_election: true
I20260806 02:17:22.935477 29311 raft_consensus.cc:2454] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86721241503447f0a7486bd8076e167f in term 0.
I20260806 02:17:22.935559 29108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0c98daf7b724076a5b2acb49d85eadc" candidate_uuid: "86721241503447f0a7486bd8076e167f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8d6d3f290be42dbabca745130ebb478" is_pre_election: true
I20260806 02:17:22.935688 29108 raft_consensus.cc:2454] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86721241503447f0a7486bd8076e167f in term 0.
I20260806 02:17:22.935911 29420 leader_election.cc:302] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86721241503447f0a7486bd8076e167f, 9f929997fdec4d9587048a3db1b95dad; no voters:
I20260806 02:17:22.936228 29629 raft_consensus.cc:2781] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:22.936295 29629 raft_consensus.cc:482] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:22.936333 29629 raft_consensus.cc:3037] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:22.937366 29629 raft_consensus.cc:504] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.937793 29629 leader_election.cc:288] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [CANDIDATE]: Term 1 election: Requested vote from peers a8d6d3f290be42dbabca745130ebb478 (127.26.189.129:38493), 9f929997fdec4d9587048a3db1b95dad (127.26.189.130:44947)
I20260806 02:17:22.938164 29108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0c98daf7b724076a5b2acb49d85eadc" candidate_uuid: "86721241503447f0a7486bd8076e167f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8d6d3f290be42dbabca745130ebb478"
I20260806 02:17:22.938215 29311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0c98daf7b724076a5b2acb49d85eadc" candidate_uuid: "86721241503447f0a7486bd8076e167f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f929997fdec4d9587048a3db1b95dad"
I20260806 02:17:22.938314 29108 raft_consensus.cc:3037] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:22.938360 29311 raft_consensus.cc:3037] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:22.939266 29108 raft_consensus.cc:2454] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86721241503447f0a7486bd8076e167f in term 1.
I20260806 02:17:22.939610 29424 leader_election.cc:302] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86721241503447f0a7486bd8076e167f, a8d6d3f290be42dbabca745130ebb478; no voters:
I20260806 02:17:22.939735 29311 raft_consensus.cc:2454] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86721241503447f0a7486bd8076e167f in term 1.
I20260806 02:17:22.939851 29629 raft_consensus.cc:2781] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:22.940080 29629 raft_consensus.cc:686] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 1 LEADER]: Becoming Leader. State: Replica: 86721241503447f0a7486bd8076e167f, State: Running, Role: LEADER
I20260806 02:17:22.940339 29629 consensus_queue.cc:237] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.943055 28884 catalog_manager.cc:5495] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f reported cstate change: term changed from 0 to 1, leader changed from <none> to 86721241503447f0a7486bd8076e167f (127.26.189.131). New cstate: current_term: 1 leader_uuid: "86721241503447f0a7486bd8076e167f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } health_report { overall_health: HEALTHY } } }
Aug 06 02:17:22 dist-test-slave-gkw7 krb5kdc[28824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982641, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:22.981171 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.971699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37863 (local address 127.0.0.1:45494)
0806 02:17:22.972022 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:22.972039 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:22.972173 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:22.972496 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:22.972499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:22.972930 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:22.973035 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.973041 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.974189 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.974192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.974772 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:22.974780 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.975365 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.975368 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:22.975475 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.976122 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:22.976135 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:22.977638 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:22.979572 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.979580 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.979585 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.979833 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.980111 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:22.980114 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:22.980115 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:22.980280 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:22.980697 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:22.980703 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:22.980824 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 02:17:22.980918 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 02:17:22.981033 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":30,"thread_start_us":126,"threads_started":1}
I20260806 02:17:22.981570 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:22.971821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45494 (local address 127.26.189.190:37863)
0806 02:17:22.971972 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:22.971977 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:22.972127 (+ 150us) server_negotiation.cc:407] Connection header received
0806 02:17:22.972265 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:22.972269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:22.972320 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:22.972423 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:22.973206 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.974069 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.974893 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:22.975244 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:22.975354 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:22.977780 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:22.977784 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:22.977788 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:22.977816 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:22.979458 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.979929 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.979933 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.979935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.980021 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:22.980370 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:22.980373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:22.980375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:22.980589 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:22.980692 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:22.980992 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 02:17:22.981110 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":54}
I20260806 02:17:22.985874 28884 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:45494:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 02:17:22.986820 28884 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:22.992795 29280 tablet_service.cc:1467] Processing CreateTablet for tablet adf96399ae02419c936fc3fb78d15e85 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e02a660124f441f487ba44cea9bc0c87]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 02:17:22.992825 29074 tablet_service.cc:1467] Processing CreateTablet for tablet adf96399ae02419c936fc3fb78d15e85 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e02a660124f441f487ba44cea9bc0c87]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 02:17:22.992884 29488 tablet_service.cc:1467] Processing CreateTablet for tablet adf96399ae02419c936fc3fb78d15e85 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e02a660124f441f487ba44cea9bc0c87]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 02:17:22.993242 29488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf96399ae02419c936fc3fb78d15e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:22.993248 29074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf96399ae02419c936fc3fb78d15e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:22.993249 29280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf96399ae02419c936fc3fb78d15e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:22.995846 29621 tablet_bootstrap.cc:492] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad: Bootstrap starting.
I20260806 02:17:22.996241 29618 tablet_bootstrap.cc:492] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f: Bootstrap starting.
I20260806 02:17:22.996832 29621 tablet_bootstrap.cc:654] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:22.996973 29615 tablet_bootstrap.cc:492] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: Bootstrap starting.
I20260806 02:17:22.997241 29618 tablet_bootstrap.cc:654] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:22.998056 29615 tablet_bootstrap.cc:654] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:22.998144 29621 tablet_bootstrap.cc:492] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad: No bootstrap required, opened a new log
I20260806 02:17:22.998229 29621 ts_tablet_manager.cc:1397] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 02:17:22.998571 29618 tablet_bootstrap.cc:492] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f: No bootstrap required, opened a new log
I20260806 02:17:22.998544 29621 raft_consensus.cc:348] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.998654 29618 ts_tablet_manager.cc:1397] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 02:17:22.998637 29621 raft_consensus.cc:374] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:22.998698 29621 raft_consensus.cc:729] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f929997fdec4d9587048a3db1b95dad, State: Initialized, Role: FOLLOWER
I20260806 02:17:22.998834 29621 consensus_queue.cc:260] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.999153 29621 ts_tablet_manager.cc:1428] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:22.999365 29648 tablet_replica.cc:439] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } }
I20260806 02:17:22.999511 29648 tablet_replica.cc:442] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:22.999454 29618 raft_consensus.cc:348] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.999574 29618 raft_consensus.cc:374] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:22.999614 29618 raft_consensus.cc:729] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86721241503447f0a7486bd8076e167f, State: Initialized, Role: FOLLOWER
I20260806 02:17:22.999804 29615 tablet_bootstrap.cc:492] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: No bootstrap required, opened a new log
I20260806 02:17:22.999740 29618 consensus_queue.cc:260] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:22.999888 29615 ts_tablet_manager.cc:1397] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 02:17:23.000159 29618 ts_tablet_manager.cc:1428] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:23.000088 29662 tablet_replica.cc:439] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } }
I20260806 02:17:23.000231 29662 tablet_replica.cc:442] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:23.000535 29615 raft_consensus.cc:348] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:23.000653 29615 raft_consensus.cc:374] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:23.000695 29615 raft_consensus.cc:729] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8d6d3f290be42dbabca745130ebb478, State: Initialized, Role: FOLLOWER
I20260806 02:17:23.000819 29615 consensus_queue.cc:260] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:23.001075 29628 tablet_replica.cc:439] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } }
I20260806 02:17:23.001224 29628 tablet_replica.cc:442] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:23.001088 29615 ts_tablet_manager.cc:1428] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260806 02:17:23.076681 29179 tablet.cc:2369] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:17:23.234732 29628 raft_consensus.cc:482] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:23.234877 29628 raft_consensus.cc:504] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:23.235356 29628 leader_election.cc:288] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f929997fdec4d9587048a3db1b95dad (127.26.189.130:44947), 86721241503447f0a7486bd8076e167f (127.26.189.131:44549)
I20260806 02:17:23.235822 29519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf96399ae02419c936fc3fb78d15e85" candidate_uuid: "a8d6d3f290be42dbabca745130ebb478" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86721241503447f0a7486bd8076e167f" is_pre_election: true
I20260806 02:17:23.235869 29311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf96399ae02419c936fc3fb78d15e85" candidate_uuid: "a8d6d3f290be42dbabca745130ebb478" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f929997fdec4d9587048a3db1b95dad" is_pre_election: true
I20260806 02:17:23.236001 29519 raft_consensus.cc:2454] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8d6d3f290be42dbabca745130ebb478 in term 0.
I20260806 02:17:23.236069 29311 raft_consensus.cc:2454] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8d6d3f290be42dbabca745130ebb478 in term 0.
I20260806 02:17:23.236402 29012 leader_election.cc:302] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86721241503447f0a7486bd8076e167f, a8d6d3f290be42dbabca745130ebb478; no voters:
I20260806 02:17:23.236608 29628 raft_consensus.cc:2781] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:23.236672 29628 raft_consensus.cc:482] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:23.236699 29628 raft_consensus.cc:3037] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:23.237762 29628 raft_consensus.cc:504] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:23.238112 29628 leader_election.cc:288] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [CANDIDATE]: Term 1 election: Requested vote from peers 9f929997fdec4d9587048a3db1b95dad (127.26.189.130:44947), 86721241503447f0a7486bd8076e167f (127.26.189.131:44549)
I20260806 02:17:23.238502 29519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf96399ae02419c936fc3fb78d15e85" candidate_uuid: "a8d6d3f290be42dbabca745130ebb478" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86721241503447f0a7486bd8076e167f"
I20260806 02:17:23.238525 29311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf96399ae02419c936fc3fb78d15e85" candidate_uuid: "a8d6d3f290be42dbabca745130ebb478" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f929997fdec4d9587048a3db1b95dad"
I20260806 02:17:23.238634 29311 raft_consensus.cc:3037] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:23.238672 29519 raft_consensus.cc:3037] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:23.239739 29311 raft_consensus.cc:2454] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8d6d3f290be42dbabca745130ebb478 in term 1.
I20260806 02:17:23.239837 29519 raft_consensus.cc:2454] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8d6d3f290be42dbabca745130ebb478 in term 1.
I20260806 02:17:23.240067 29011 leader_election.cc:302] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f929997fdec4d9587048a3db1b95dad, a8d6d3f290be42dbabca745130ebb478; no voters:
I20260806 02:17:23.240271 29628 raft_consensus.cc:2781] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:23.240536 29628 raft_consensus.cc:686] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [term 1 LEADER]: Becoming Leader. State: Replica: a8d6d3f290be42dbabca745130ebb478, State: Running, Role: LEADER
I20260806 02:17:23.240806 29628 consensus_queue.cc:237] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } }
I20260806 02:17:23.242324 29679 tablet_replica.cc:439] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: TxnStatusTablet state changed. Reason: New leader a8d6d3f290be42dbabca745130ebb478. Latest consensus state: current_term: 1 leader_uuid: "a8d6d3f290be42dbabca745130ebb478" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } }
I20260806 02:17:23.242482 29679 tablet_replica.cc:442] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: This TxnStatusTablet replica's current role is: LEADER
I20260806 02:17:23.242833 29681 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 02:17:23.243068 29681 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 02:17:23.243907 28884 catalog_manager.cc:5495] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8d6d3f290be42dbabca745130ebb478 (127.26.189.129). New cstate: current_term: 1 leader_uuid: "a8d6d3f290be42dbabca745130ebb478" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } health_report { overall_health: UNKNOWN } } }
I20260806 02:17:23.297600 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:23.293290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38493 (local address 127.0.0.1:42910)
0806 02:17:23.293572 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:23.293588 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:23.293696 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:23.294042 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:23.294045 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:23.294053 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 02:17:23.294178 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:23.294185 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.294933 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.294936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:23.295920 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:23.295931 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.296394 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.296398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:23.296503 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:23.296558 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 02:17:23.297241 (+ 683us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 02:17:23.297260 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 02:17:23.297334 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 02:17:23.297428 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149}
I20260806 02:17:23.297600 29614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:23.293480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42910 (local address 127.26.189.129:38493)
0806 02:17:23.293637 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:23.293641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:23.293655 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:17:23.293854 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:23.293856 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:23.293912 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:23.294002 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:23.294291 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.294822 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.296044 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.296274 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.296357 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:23.296704 (+ 347us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:23.297125 (+ 421us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:23.297273 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:23.297346 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 02:17:23.297406 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 02:17:23.300750 29519 raft_consensus.cc:1261] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f [term 1 FOLLOWER]: Refusing update from remote peer a8d6d3f290be42dbabca745130ebb478: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:23.301234 29679 consensus_queue.cc:1035] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:23.301379 29311 raft_consensus.cc:1261] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad [term 1 FOLLOWER]: Refusing update from remote peer a8d6d3f290be42dbabca745130ebb478: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:23.301927 29679 consensus_queue.cc:1035] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:23.302980 29662 tablet_replica.cc:439] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f: TxnStatusTablet state changed. Reason: New leader a8d6d3f290be42dbabca745130ebb478. Latest consensus state: current_term: 1 leader_uuid: "a8d6d3f290be42dbabca745130ebb478" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } }
I20260806 02:17:23.303109 29662 tablet_replica.cc:442] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:23.303434 29648 tablet_replica.cc:439] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad: TxnStatusTablet state changed. Reason: New leader a8d6d3f290be42dbabca745130ebb478. Latest consensus state: current_term: 1 leader_uuid: "a8d6d3f290be42dbabca745130ebb478" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } }
I20260806 02:17:23.303535 29648 tablet_replica.cc:442] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:23.306499 29628 tablet_replica.cc:439] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a8d6d3f290be42dbabca745130ebb478" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } }
I20260806 02:17:23.306625 29628 tablet_replica.cc:442] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: This TxnStatusTablet replica's current role is: LEADER
I20260806 02:17:23.306746 29628 tablet_replica.cc:439] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a8d6d3f290be42dbabca745130ebb478" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } }
I20260806 02:17:23.306823 29628 tablet_replica.cc:442] T adf96399ae02419c936fc3fb78d15e85 P a8d6d3f290be42dbabca745130ebb478: This TxnStatusTablet replica's current role is: LEADER
I20260806 02:17:23.307262 29662 tablet_replica.cc:439] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a8d6d3f290be42dbabca745130ebb478" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } }
I20260806 02:17:23.307370 29662 tablet_replica.cc:442] T adf96399ae02419c936fc3fb78d15e85 P 86721241503447f0a7486bd8076e167f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:23.307461 29643 mvcc.cc:205] Tried to move back new op lower bound from 7315384906954649600 to 7315384906717323264. Current Snapshot: MvccSnapshot[applied={T|T < 7315384906954649600 or (T in {7315384906954649600})}]
I20260806 02:17:23.309154 29648 tablet_replica.cc:439] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a8d6d3f290be42dbabca745130ebb478" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 } } peers { permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 } } peers { permanent_uuid: "86721241503447f0a7486bd8076e167f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44549 } } }
I20260806 02:17:23.309259 29648 tablet_replica.cc:442] T adf96399ae02419c936fc3fb78d15e85 P 9f929997fdec4d9587048a3db1b95dad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:23.320086 29690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:23.315226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40532 (local address 127.26.189.131:44549)
0806 02:17:23.315569 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:23.315574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:23.315607 (+ 33us) server_negotiation.cc:407] Connection header received
0806 02:17:23.315682 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:23.315685 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:23.315752 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:23.315916 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:23.316208 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.317056 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.318309 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.318666 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.318781 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:23.319077 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:23.319655 (+ 578us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:23.319773 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:23.319849 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 02:17:23.319907 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":60,"threads_started":1}
I20260806 02:17:23.331715 29614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:23.327678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:54809 (local address 127.26.189.129:38493)
0806 02:17:23.327841 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:23.327846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:23.328022 (+ 176us) server_negotiation.cc:407] Connection header received
0806 02:17:23.328177 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:23.328179 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:23.328226 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:23.328297 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:23.328554 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.329210 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.330496 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.330879 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.330971 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:23.331305 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:23.331376 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:23.331437 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:23.331556 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 02:17:23.331603 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 02:17:23.331774 29695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:23.327600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38493 (local address 127.26.189.131:54809)
0806 02:17:23.327946 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:23.327962 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:23.328092 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:23.328326 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:23.328329 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:23.328337 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 02:17:23.328461 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:23.328467 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.329321 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.329325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:23.330367 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:23.330379 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.330996 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.331000 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:23.331108 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:23.331161 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 02:17:23.331461 (+ 300us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 02:17:23.331468 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 02:17:23.331534 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 02:17:23.331613 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":140,"threads_started":1}
I20260806 02:17:23.339526 29311 raft_consensus.cc:1261] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad [term 1 FOLLOWER]: Refusing update from remote peer 86721241503447f0a7486bd8076e167f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:23.339604 29108 raft_consensus.cc:1261] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478 [term 1 FOLLOWER]: Refusing update from remote peer 86721241503447f0a7486bd8076e167f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:23.340088 29629 consensus_queue.cc:1035] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f929997fdec4d9587048a3db1b95dad" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:23.340324 29662 consensus_queue.cc:1035] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8d6d3f290be42dbabca745130ebb478" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:23.365302 29690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:23.360528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:57933 (local address 127.26.189.131:44549)
0806 02:17:23.360666 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:23.360670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:23.360988 (+ 318us) server_negotiation.cc:407] Connection header received
0806 02:17:23.361309 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:23.361313 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:23.361374 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:23.361465 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:23.361967 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.362745 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.364048 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.364298 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.364402 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:23.364781 (+ 379us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:23.364854 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:23.364947 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:23.365067 (+ 120us) server_negotiation.cc:299] Negotiation successful
0806 02:17:23.365133 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 02:17:23.365342 29700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:23.360436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:44549 (local address 127.26.189.129:57933)
0806 02:17:23.360887 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:23.360901 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:23.361158 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:23.361489 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:23.361493 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:23.361702 (+ 209us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 02:17:23.361840 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:23.361847 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.362863 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.362866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:23.363891 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:23.363904 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.364422 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.364426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:23.364548 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:23.364608 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 02:17:23.364943 (+ 335us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 02:17:23.364953 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 02:17:23.365037 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 02:17:23.365137 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":72,"threads_started":1}
I20260806 02:17:23.392755 28884 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:23.392915 28884 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:23.395035 28884 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b06ae3c14c2e40c79d1d0f27118033ae: Sending DeleteTablet for 3 replicas of tablet a0c98daf7b724076a5b2acb49d85eadc
I20260806 02:17:23.395869 29488 tablet_service.cc:1514] Processing DeleteTablet for tablet a0c98daf7b724076a5b2acb49d85eadc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:23 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:40516
I20260806 02:17:23.396301 29074 tablet_service.cc:1514] Processing DeleteTablet for tablet a0c98daf7b724076a5b2acb49d85eadc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:23 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:42898
I20260806 02:17:23.396665 29280 tablet_service.cc:1514] Processing DeleteTablet for tablet a0c98daf7b724076a5b2acb49d85eadc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:23 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:44430
I20260806 02:17:23.396706 29706 tablet_replica.cc:330] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f: stopping tablet replica
I20260806 02:17:23.396831 29706 raft_consensus.cc:2229] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:17:23.397141 29706 raft_consensus.cc:2258] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:23.397886 29706 ts_tablet_manager.cc:1905] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:23.398411 29707 tablet_replica.cc:330] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478: stopping tablet replica
I20260806 02:17:23.398627 29708 tablet_replica.cc:330] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad: stopping tablet replica
I20260806 02:17:23.398808 29708 raft_consensus.cc:2229] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:23.398976 29707 raft_consensus.cc:2229] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:23.399149 29708 raft_consensus.cc:2258] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:23.399339 29707 raft_consensus.cc:2258] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:23.400869 29707 ts_tablet_manager.cc:1905] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:23.401085 29708 ts_tablet_manager.cc:1905] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:23.401286 29706 ts_tablet_manager.cc:1918] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:23.401376 29706 log.cc:1196] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/a0c98daf7b724076a5b2acb49d85eadc
I20260806 02:17:23.401706 29706 ts_tablet_manager.cc:1939] T a0c98daf7b724076a5b2acb49d85eadc P 86721241503447f0a7486bd8076e167f: Deleting consensus metadata
I20260806 02:17:23.402407 28866 catalog_manager.cc:4841] TS 86721241503447f0a7486bd8076e167f (127.26.189.131:44549): tablet a0c98daf7b724076a5b2acb49d85eadc (table test-table [id=6b77b5ac4e0945dab3dd29bd5eb36937]) successfully deleted
I20260806 02:17:23.404438 29707 ts_tablet_manager.cc:1918] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:23.404541 29707 log.cc:1196] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-0/wal/wals/a0c98daf7b724076a5b2acb49d85eadc
I20260806 02:17:23.404810 29707 ts_tablet_manager.cc:1939] T a0c98daf7b724076a5b2acb49d85eadc P a8d6d3f290be42dbabca745130ebb478: Deleting consensus metadata
I20260806 02:17:23.405488 28869 catalog_manager.cc:4841] TS a8d6d3f290be42dbabca745130ebb478 (127.26.189.129:38493): tablet a0c98daf7b724076a5b2acb49d85eadc (table test-table [id=6b77b5ac4e0945dab3dd29bd5eb36937]) successfully deleted
I20260806 02:17:23.406989 29708 ts_tablet_manager.cc:1918] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:23.407099 29708 log.cc:1196] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/a0c98daf7b724076a5b2acb49d85eadc
I20260806 02:17:23.407369 29708 ts_tablet_manager.cc:1939] T a0c98daf7b724076a5b2acb49d85eadc P 9f929997fdec4d9587048a3db1b95dad: Deleting consensus metadata
I20260806 02:17:23.408087 28865 catalog_manager.cc:4841] TS 9f929997fdec4d9587048a3db1b95dad (127.26.189.130:44947): tablet a0c98daf7b724076a5b2acb49d85eadc (table test-table [id=6b77b5ac4e0945dab3dd29bd5eb36937]) successfully deleted
Aug 06 02:17:23 dist-test-slave-gkw7 krb5kdc[28824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982642, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.189.129@KRBTEST.COM
I20260806 02:17:23.418726 29614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:23.401974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42920 (local address 127.26.189.129:38493)
0806 02:17:23.402094 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:23.402099 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:23.408228 (+ 6129us) server_negotiation.cc:407] Connection header received
0806 02:17:23.408453 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:23.408456 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:23.408513 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:23.408605 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:23.409313 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.409911 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.410760 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.410981 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.411096 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:23.414839 (+ 3743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:23.414850 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:23.414870 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:23.414900 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:23.416679 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:23.417151 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:23.417157 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:23.417159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:23.417257 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:23.417578 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:23.417582 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:23.417583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:23.417873 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:23.418081 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:23.418439 (+ 358us) server_negotiation.cc:299] Negotiation successful
0806 02:17:23.418564 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260806 02:17:23.419291 29155 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42920
I20260806 02:17:23.430233 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:23.422236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45496 (local address 127.26.189.190:37863)
0806 02:17:23.422388 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:23.422392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:23.422797 (+ 405us) server_negotiation.cc:407] Connection header received
0806 02:17:23.422920 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:23.422922 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:23.422977 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:23.423065 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:23.423734 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.424277 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.425075 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:23.425308 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:23.425418 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:23.426842 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:23.426846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:23.426849 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:23.426884 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:23.428438 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:23.428867 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:23.428871 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:23.428873 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:23.428961 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:23.429260 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:23.429264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:23.429265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:23.429453 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:23.429630 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:23.429910 (+ 280us) server_negotiation.cc:299] Negotiation successful
0806 02:17:23.430072 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260806 02:17:23.430856 28884 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45496
I20260806 02:17:23.432350 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 28985
I20260806 02:17:23.453353 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 29193
I20260806 02:17:23.466581 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 29392
I20260806 02:17:23.479727 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 28840
2026-08-06T02:17:23Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3258 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:23 dist-test-slave-gkw7 krb5kdc[29719](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:23 dist-test-slave-gkw7 krb5kdc[29719](info): set up 2 sockets
Aug 06 02:17:23 dist-test-slave-gkw7 krb5kdc[29719](info): commencing operation
krb5kdc: starting...
W20260806 02:17:24.690444 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:24 dist-test-slave-gkw7 krb5kdc[29719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:17:24.824954 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:46651
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:33665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:46651
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:24.942626 29743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:24.942930 29743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:24.943017 29743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:24.947145 29743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:24.947211 29743 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 02:17:24.947228 29743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:24.947247 29743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:24.947263 29743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:24.947328 29743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:24.952879 29743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:33665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:46651
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:46651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:24.954108 29743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:24.955232 29743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:24.964341 29752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:24.964303 29749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:24.964371 29748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:24.964666 29743 server_base.cc:1034] running on GCE node
I20260806 02:17:24.965317 29743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:24.966576 29743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:24.967747 29743 hybrid_clock.cc:648] HybridClock initialized: now 1785982644967717 us; error 44 us; skew 500 ppm
Aug 06 02:17:24 dist-test-slave-gkw7 krb5kdc[29719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982644, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:24.970692 29743 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:17:24.971545 29743 webserver.cc:460] Webserver started at http://127.26.189.190:43423/ using document root <none> and password file <none>
I20260806 02:17:24.972121 29743 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:24.972180 29743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:24.972494 29743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:24.974676 29743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "9a548914f6eb49c2a365ad8dc6e4b714"
format_stamp: "Formatted at 2026-08-06 02:17:24 on dist-test-slave-gkw7"
server_key: "ab1fe7c2f7de667114be0bdddd5546c7"
server_key_iv: "ce82805ecc22e041e0cb3fa9a274fa1f"
server_key_version: "encryptionkey@0"
I20260806 02:17:24.975302 29743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "9a548914f6eb49c2a365ad8dc6e4b714"
format_stamp: "Formatted at 2026-08-06 02:17:24 on dist-test-slave-gkw7"
server_key: "ab1fe7c2f7de667114be0bdddd5546c7"
server_key_iv: "ce82805ecc22e041e0cb3fa9a274fa1f"
server_key_version: "encryptionkey@0"
I20260806 02:17:24.979283 29743 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:24.981992 29768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:24.983424 29743 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 02:17:24.983536 29743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "9a548914f6eb49c2a365ad8dc6e4b714"
format_stamp: "Formatted at 2026-08-06 02:17:24 on dist-test-slave-gkw7"
server_key: "ab1fe7c2f7de667114be0bdddd5546c7"
server_key_iv: "ce82805ecc22e041e0cb3fa9a274fa1f"
server_key_version: "encryptionkey@0"
I20260806 02:17:24.983686 29743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:25.003720 29743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:25.007429 29743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:25.007663 29743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:25.016598 29743 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:46651
I20260806 02:17:25.016676 29871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:46651 every 8 connection(s)
I20260806 02:17:25.017714 29743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:25.020701 29875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:25.022853 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 29743
I20260806 02:17:25.022965 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:25.023248 27382 external_mini_cluster.cc:1428] Setting key 8135cde8ddf44c5b3e9421f7f77f6ced
I20260806 02:17:25.027940 29875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714: Bootstrap starting.
I20260806 02:17:25.030707 29875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:25.031682 29875 log.cc:824] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714: Log is configured to *not* fsync() on all Append() calls
Aug 06 02:17:25 dist-test-slave-gkw7 krb5kdc[29719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:25.034293 29875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714: No bootstrap required, opened a new log
I20260806 02:17:25.038744 29875 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a548914f6eb49c2a365ad8dc6e4b714" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46651 } }
I20260806 02:17:25.039042 29875 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:25.039104 29875 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a548914f6eb49c2a365ad8dc6e4b714, State: Initialized, Role: FOLLOWER
I20260806 02:17:25.039502 29878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.024714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50438 (local address 127.26.189.190:46651)
0806 02:17:25.025168 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:25.025185 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:25.025223 (+ 38us) server_negotiation.cc:407] Connection header received
0806 02:17:25.025998 (+ 775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:25.026019 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:25.026386 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:25.026681 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:25.027612 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.028688 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.029911 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.030391 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.030513 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.033398 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:25.033404 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:25.033421 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:25.033452 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:25.036128 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.036592 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.036601 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.036607 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.036767 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.037056 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.037059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.037062 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.037666 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:25.037917 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:25.038122 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 02:17:25.038452 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":142,"threads_started":1}
I20260806 02:17:25.039618 29875 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a548914f6eb49c2a365ad8dc6e4b714" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46651 } }
I20260806 02:17:25.039783 29875 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:25.039856 29875 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:25.039956 29875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:25.041079 29875 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a548914f6eb49c2a365ad8dc6e4b714" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46651 } }
I20260806 02:17:25.041455 29875 leader_election.cc:302] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a548914f6eb49c2a365ad8dc6e4b714; no voters:
I20260806 02:17:25.041939 29875 leader_election.cc:288] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:25.042023 29880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:25.042212 29880 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [term 1 LEADER]: Becoming Leader. State: Replica: 9a548914f6eb49c2a365ad8dc6e4b714, State: Running, Role: LEADER
I20260806 02:17:25.042516 29880 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a548914f6eb49c2a365ad8dc6e4b714" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46651 } }
I20260806 02:17:25.043295 29875 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:25.044413 29882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a548914f6eb49c2a365ad8dc6e4b714. Latest consensus state: current_term: 1 leader_uuid: "9a548914f6eb49c2a365ad8dc6e4b714" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a548914f6eb49c2a365ad8dc6e4b714" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46651 } } }
I20260806 02:17:25.044479 29881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a548914f6eb49c2a365ad8dc6e4b714" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a548914f6eb49c2a365ad8dc6e4b714" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46651 } } }
I20260806 02:17:25.044548 29882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:25.044584 29881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:25.045902 29894 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:25.049160 29894 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:25.056322 29894 catalog_manager.cc:1347] Generated new cluster ID: 8c2eedf921154965a0b783602d99ca19
I20260806 02:17:25.056416 29894 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:25.065879 29894 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:25.066864 29894 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:25.075044 29894 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714: Generated new TSK 0
I20260806 02:17:25.075802 29894 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:17:25.108611 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:46651
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:33665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:25.228801 29910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:25.229071 29910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:25.229156 29910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:25.233235 29910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:25.233296 29910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:25.233335 29910 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 02:17:25.233387 29910 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 02:17:25.233454 29910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:25.238847 29910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:33665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.189.190:46651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:25.239933 29910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:25.240990 29910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:25.251118 29918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:25.251276 29910 server_base.cc:1034] running on GCE node
W20260806 02:17:25.251123 29916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:25.251443 29923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:25.251847 29910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:25.252525 29910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:25.253697 29910 hybrid_clock.cc:648] HybridClock initialized: now 1785982645253661 us; error 49 us; skew 500 ppm
Aug 06 02:17:25 dist-test-slave-gkw7 krb5kdc[29719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982645, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:25.256435 29910 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:17:25.257293 29910 webserver.cc:460] Webserver started at http://127.26.189.129:43743/ using document root <none> and password file <none>
I20260806 02:17:25.257936 29910 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:25.258035 29910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:25.258281 29910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:25.260586 29910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "7fc5fc08bce045e7a8ec76d0c697021f"
format_stamp: "Formatted at 2026-08-06 02:17:25 on dist-test-slave-gkw7"
server_key: "a0594f043a765a366b045e4a4f59296f"
server_key_iv: "5df1be35da0e3c8398dfe79e4cd693b0"
server_key_version: "encryptionkey@0"
I20260806 02:17:25.261178 29910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "7fc5fc08bce045e7a8ec76d0c697021f"
format_stamp: "Formatted at 2026-08-06 02:17:25 on dist-test-slave-gkw7"
server_key: "a0594f043a765a366b045e4a4f59296f"
server_key_iv: "5df1be35da0e3c8398dfe79e4cd693b0"
server_key_version: "encryptionkey@0"
I20260806 02:17:25.265090 29910 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:17:25.267699 29931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:25.269064 29910 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 02:17:25.269210 29910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "7fc5fc08bce045e7a8ec76d0c697021f"
format_stamp: "Formatted at 2026-08-06 02:17:25 on dist-test-slave-gkw7"
server_key: "a0594f043a765a366b045e4a4f59296f"
server_key_iv: "5df1be35da0e3c8398dfe79e4cd693b0"
server_key_version: "encryptionkey@0"
I20260806 02:17:25.269337 29910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:25.287810 29910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:25.290928 29910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:25.291134 29910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:25.292572 29910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:25.292649 29910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:25.292750 29910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:25.292804 29910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 02:17:25 dist-test-slave-gkw7 krb5kdc[29719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982645, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:25.305027 29910 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:38051
I20260806 02:17:25.305116 30106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:38051 every 8 connection(s)
I20260806 02:17:25.306208 29910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:25.306663 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 29910
I20260806 02:17:25.306818 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:17:25.307186 27382 external_mini_cluster.cc:1428] Setting key 8a73652e105c701c412e746065730345
I20260806 02:17:25.308591 29878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.293631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:46387 (local address 127.26.189.190:46651)
0806 02:17:25.293782 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:25.293786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:25.294866 (+ 1080us) server_negotiation.cc:407] Connection header received
0806 02:17:25.295869 (+ 1003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:25.295872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:25.295943 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:25.296064 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:25.297664 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.298262 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.299693 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.300048 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.300177 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.304161 (+ 3984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:25.304164 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:25.304166 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:25.304193 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:25.306032 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.306704 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.306709 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.306711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.306833 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.307297 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.307301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.307304 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.307551 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:25.307675 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:25.308250 (+ 575us) server_negotiation.cc:299] Negotiation successful
0806 02:17:25.308384 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 02:17:25.309284 29944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.294181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:46651 (local address 127.26.189.129:46387)
0806 02:17:25.294704 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:25.294754 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:25.295644 (+ 890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:25.296309 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:25.296321 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:25.296778 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:25.297460 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.297478 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.298407 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.298411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.299573 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.299586 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.300250 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.300257 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.300441 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.301082 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:25.301101 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:25.303972 (+ 2871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:25.306148 (+ 2176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:25.306153 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:25.306164 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:25.306552 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:25.306962 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:25.306966 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:25.306970 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:25.307164 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:25.307709 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:25.307715 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:25.307990 (+ 275us) client_negotiation.cc:769] Sending connection context
0806 02:17:25.308146 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 02:17:25.308386 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":158,"threads_started":1}
I20260806 02:17:25.310667 30108 heartbeater.cc:347] Connected to a master server at 127.26.189.190:46651
I20260806 02:17:25.310845 30108 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:25.311316 30108 heartbeater.cc:511] Master 127.26.189.190:46651 requested a full tablet report, sending...
I20260806 02:17:25.312875 29797 ts_manager.cc:194] Registered new tserver with Master: 7fc5fc08bce045e7a8ec76d0c697021f (127.26.189.129:38051)
I20260806 02:17:25.314576 29797 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:46387
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
I20260806 02:17:25.321767 29878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.313910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:51289 (local address 127.26.189.190:46651)
0806 02:17:25.314031 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:25.314036 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:25.314304 (+ 268us) server_negotiation.cc:407] Connection header received
0806 02:17:25.314462 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:25.314465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:25.314517 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:25.314607 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:25.315111 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.315668 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.316616 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.316888 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.317006 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.318266 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:25.318271 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:25.318275 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:25.318306 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:25.319912 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.320390 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.320394 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.320395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.320488 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.320811 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.320816 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.320819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.321011 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:25.321130 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:25.321433 (+ 303us) server_negotiation.cc:299] Negotiation successful
0806 02:17:25.321589 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 02:17:25.321836 30116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.313854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:46651 (local address 127.26.189.129:51289)
0806 02:17:25.314203 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:25.314216 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:25.314345 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:25.314625 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:25.314629 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:25.314875 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:25.314982 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.314988 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.315814 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.315818 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.316484 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.316493 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.317013 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.317017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.317143 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.317767 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:25.317779 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:25.318118 (+ 339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:25.320036 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:25.320040 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:25.320042 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:25.320272 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:25.320607 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:25.320611 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:25.320613 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:25.320709 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:25.321121 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:25.321125 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:25.321240 (+ 115us) client_negotiation.cc:769] Sending connection context
0806 02:17:25.321359 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 02:17:25.321519 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":1,"thread_start_us":99,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:17:25.341676 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:46651
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:33665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:25.458509 30119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:25.458781 30119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:25.458832 30119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:25.462939 30119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:25.463006 30119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:25.463045 30119 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 02:17:25.463060 30119 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 02:17:25.463099 30119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:25.468425 30119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:33665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.189.190:46651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:25.469468 30119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:25.470624 30119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:25.481050 30127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:25.481132 30119 server_base.cc:1034] running on GCE node
W20260806 02:17:25.481101 30128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:25.481071 30131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:25.481850 30119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:25.482520 30119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:25.483707 30119 hybrid_clock.cc:648] HybridClock initialized: now 1785982645483675 us; error 50 us; skew 500 ppm
Aug 06 02:17:25 dist-test-slave-gkw7 krb5kdc[29719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982645, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:25.486925 30119 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:17:25.488009 30119 webserver.cc:460] Webserver started at http://127.26.189.130:37453/ using document root <none> and password file <none>
I20260806 02:17:25.488682 30119 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:25.488754 30119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:25.488945 30119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:25.491309 30119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "abd5e8ec31d64322ad8e349cdc3af42e"
format_stamp: "Formatted at 2026-08-06 02:17:25 on dist-test-slave-gkw7"
server_key: "622153693c87da18d5db990da2167111"
server_key_iv: "d9680eb68adb489b2450387e63c20d24"
server_key_version: "encryptionkey@0"
I20260806 02:17:25.491927 30119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "abd5e8ec31d64322ad8e349cdc3af42e"
format_stamp: "Formatted at 2026-08-06 02:17:25 on dist-test-slave-gkw7"
server_key: "622153693c87da18d5db990da2167111"
server_key_iv: "d9680eb68adb489b2450387e63c20d24"
server_key_version: "encryptionkey@0"
I20260806 02:17:25.496011 30119 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:25.498670 30141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:25.500054 30119 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:25.500229 30119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "abd5e8ec31d64322ad8e349cdc3af42e"
format_stamp: "Formatted at 2026-08-06 02:17:25 on dist-test-slave-gkw7"
server_key: "622153693c87da18d5db990da2167111"
server_key_iv: "d9680eb68adb489b2450387e63c20d24"
server_key_version: "encryptionkey@0"
I20260806 02:17:25.500365 30119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:25.539371 30119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:25.542945 30119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:25.543162 30119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:25.544967 30119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:25.545045 30119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:25.545106 30119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:25.545138 30119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 02:17:25 dist-test-slave-gkw7 krb5kdc[29719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982645, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:25.556706 30119 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:36543
I20260806 02:17:25.556861 30309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:36543 every 8 connection(s)
I20260806 02:17:25.557909 30119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:25.559931 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 30119
I20260806 02:17:25.560039 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:17:25.560310 27382 external_mini_cluster.cc:1428] Setting key 480b794316adf032fff1b327883c5b3b
I20260806 02:17:25.561301 29878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.546059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:42751 (local address 127.26.189.190:46651)
0806 02:17:25.546225 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:25.546230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:25.547337 (+ 1107us) server_negotiation.cc:407] Connection header received
0806 02:17:25.548679 (+ 1342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:25.548687 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:25.548761 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:25.548878 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:25.550740 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.551551 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.553593 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.553851 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.553951 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.557350 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:25.557354 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:25.557356 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:25.557384 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:25.559059 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.559566 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.559577 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.559580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.559709 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.560141 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.560144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.560146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.560362 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:25.560493 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:25.561017 (+ 524us) server_negotiation.cc:299] Negotiation successful
0806 02:17:25.561149 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 02:17:25.562436 30153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.546597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:46651 (local address 127.26.189.130:42751)
0806 02:17:25.547123 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:25.547201 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:25.548393 (+ 1192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:25.549117 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:25.549128 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:25.549726 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:25.550538 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.550565 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.551720 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.551727 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.553392 (+ 1665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.553406 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.554044 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.554050 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.554302 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.555162 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:25.555188 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:25.557132 (+ 1944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:25.559186 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:25.559190 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:25.559201 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:25.559463 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:25.559855 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:25.559861 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:25.559863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:25.560043 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:25.560495 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:25.560501 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:25.560801 (+ 300us) client_negotiation.cc:769] Sending connection context
0806 02:17:25.561011 (+ 210us) client_negotiation.cc:240] Negotiation successful
0806 02:17:25.561334 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":113,"threads_started":1}
I20260806 02:17:25.563755 30310 heartbeater.cc:347] Connected to a master server at 127.26.189.190:46651
I20260806 02:17:25.563927 30310 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:25.564597 30310 heartbeater.cc:511] Master 127.26.189.190:46651 requested a full tablet report, sending...
I20260806 02:17:25.565857 29797 ts_manager.cc:194] Registered new tserver with Master: abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543)
I20260806 02:17:25.566522 29797 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:42751
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
I20260806 02:17:25.574476 30325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.566172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:46651 (local address 127.26.189.130:35041)
0806 02:17:25.566460 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:25.566478 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:25.566569 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:25.567137 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:25.567141 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:25.567366 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:25.567479 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.567487 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.568644 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.568647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.569240 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.569248 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.569827 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.569830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.569925 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.570488 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:25.570500 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:25.570811 (+ 311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:25.572625 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:25.572629 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:25.572631 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:25.572840 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:25.573133 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:25.573137 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:25.573138 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:25.573384 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:25.573909 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:25.573911 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:25.573984 (+ 73us) client_negotiation.cc:769] Sending connection context
0806 02:17:25.574095 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 02:17:25.574264 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":109,"threads_started":1}
I20260806 02:17:25.574463 29878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.566840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:35041 (local address 127.26.189.190:46651)
0806 02:17:25.566944 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:25.566954 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:25.566965 (+ 11us) server_negotiation.cc:407] Connection header received
0806 02:17:25.566993 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:25.566995 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:25.567025 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:25.567116 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:25.567639 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.568504 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.569373 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.569705 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.569840 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.570974 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:25.570978 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:25.570981 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:25.571005 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:25.572515 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.572944 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.572949 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.572950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.573037 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.573513 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.573516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.573518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.573780 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:25.573844 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:25.574154 (+ 310us) server_negotiation.cc:299] Negotiation successful
0806 02:17:25.574269 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:17:25.593282 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:46651
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:33665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:25.716780 30329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:25.717123 30329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:25.717176 30329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:25.721131 30329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:25.721185 30329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:25.721225 30329 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 02:17:25.721239 30329 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 02:17:25.721271 30329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:25.726493 30329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:33665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.189.190:46651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:25.727555 30329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:25.728605 30329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:25.738799 30344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:25.738799 30338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:25.738857 30337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:25.739243 30329 server_base.cc:1034] running on GCE node
I20260806 02:17:25.739622 30329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:25.740338 30329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:25.741621 30329 hybrid_clock.cc:648] HybridClock initialized: now 1785982645741598 us; error 24 us; skew 500 ppm
Aug 06 02:17:25 dist-test-slave-gkw7 krb5kdc[29719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982645, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:25.744757 30329 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:17:25.745811 30329 webserver.cc:460] Webserver started at http://127.26.189.131:46413/ using document root <none> and password file <none>
I20260806 02:17:25.746352 30329 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:25.746413 30329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:25.746579 30329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:25.748621 30329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "0da7131c50cb42d3a3464756e206110b"
format_stamp: "Formatted at 2026-08-06 02:17:25 on dist-test-slave-gkw7"
server_key: "943368e5d056cdfd65cea285b0dc37f5"
server_key_iv: "718b937ba04d2ea6c4f097e1b5494785"
server_key_version: "encryptionkey@0"
I20260806 02:17:25.749145 30329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "0da7131c50cb42d3a3464756e206110b"
format_stamp: "Formatted at 2026-08-06 02:17:25 on dist-test-slave-gkw7"
server_key: "943368e5d056cdfd65cea285b0dc37f5"
server_key_iv: "718b937ba04d2ea6c4f097e1b5494785"
server_key_version: "encryptionkey@0"
I20260806 02:17:25.752877 30329 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 02:17:25.755431 30355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:25.756860 30329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 02:17:25.756971 30329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "0da7131c50cb42d3a3464756e206110b"
format_stamp: "Formatted at 2026-08-06 02:17:25 on dist-test-slave-gkw7"
server_key: "943368e5d056cdfd65cea285b0dc37f5"
server_key_iv: "718b937ba04d2ea6c4f097e1b5494785"
server_key_version: "encryptionkey@0"
I20260806 02:17:25.757068 30329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:25.801970 30329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:25.805300 30329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:25.805475 30329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:25.807058 30329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:25.807125 30329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:25.807197 30329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:25.807235 30329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 02:17:25 dist-test-slave-gkw7 krb5kdc[29719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982645, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:25.819099 30329 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:46883
I20260806 02:17:25.819129 30531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:46883 every 8 connection(s)
I20260806 02:17:25.820092 30329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:25.821204 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 30329
I20260806 02:17:25.821358 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:17:25.821725 27382 external_mini_cluster.cc:1428] Setting key be1942cffa7ce7d74fe488af9af61ddf
I20260806 02:17:25.822880 29878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.807941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:44341 (local address 127.26.189.190:46651)
0806 02:17:25.808135 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:25.808141 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:25.808974 (+ 833us) server_negotiation.cc:407] Connection header received
0806 02:17:25.810131 (+ 1157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:25.810135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:25.810192 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:25.810282 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:25.812216 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.813067 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.815177 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.815544 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.815685 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.818786 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:25.818791 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:25.818797 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:25.818833 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:25.820496 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.821107 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.821111 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.821113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.821205 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.821646 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.821649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.821651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.821912 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:25.822032 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:25.822576 (+ 544us) server_negotiation.cc:299] Negotiation successful
0806 02:17:25.822701 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 02:17:25.823745 30368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.808334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:46651 (local address 127.26.189.131:44341)
0806 02:17:25.808806 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:25.808857 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:25.809918 (+ 1061us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:25.810614 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:25.810624 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:25.811303 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:25.812054 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.812076 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.813243 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.813251 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.815024 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.815038 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.815857 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.815860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.816001 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.816609 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:25.816628 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:25.818591 (+ 1963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:25.820636 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:25.820641 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:25.820655 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:25.820995 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:25.821307 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:25.821311 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:25.821313 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:25.821515 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:25.822030 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:25.822037 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:25.822324 (+ 287us) client_negotiation.cc:769] Sending connection context
0806 02:17:25.822511 (+ 187us) client_negotiation.cc:240] Negotiation successful
0806 02:17:25.822828 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":129,"threads_started":1}
I20260806 02:17:25.825001 30532 heartbeater.cc:347] Connected to a master server at 127.26.189.190:46651
I20260806 02:17:25.825163 30532 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:25.825743 30532 heartbeater.cc:511] Master 127.26.189.190:46651 requested a full tablet report, sending...
I20260806 02:17:25.826826 29798 ts_manager.cc:194] Registered new tserver with Master: 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883)
I20260806 02:17:25.827674 29798 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:44341
I20260806 02:17:25.834641 29878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.827465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:43091 (local address 127.26.189.190:46651)
0806 02:17:25.827576 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:25.827580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:25.827813 (+ 233us) server_negotiation.cc:407] Connection header received
0806 02:17:25.827949 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:25.827952 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:25.827999 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:25.828082 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:25.828569 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.829113 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.830111 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.830363 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.830457 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.831475 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:25.831479 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:25.831481 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:25.831502 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:25.832961 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.833335 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.833338 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.833339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.833413 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.833842 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.833845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.833846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.834020 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:25.834103 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:25.834388 (+ 285us) server_negotiation.cc:299] Negotiation successful
0806 02:17:25.834506 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 02:17:25.834677 30538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.827388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:46651 (local address 127.26.189.131:43091)
0806 02:17:25.827718 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:25.827738 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:25.827853 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:25.828100 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:25.828103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:25.828321 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:25.828446 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.828453 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.829257 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.829261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.829987 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.829996 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.830476 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.830478 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.830547 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.831029 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:25.831040 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:25.831347 (+ 307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:25.833064 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:25.833066 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:25.833068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:25.833252 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:25.833622 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:25.833626 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:25.833629 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:25.833743 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:25.834120 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:25.834122 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:25.834208 (+ 86us) client_negotiation.cc:769] Sending connection context
0806 02:17:25.834315 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 02:17:25.834450 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":1,"thread_start_us":95,"threads_started":1}
I20260806 02:17:25.836139 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 02:17:25 dist-test-slave-gkw7 krb5kdc[29719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 02:17:25 dist-test-slave-gkw7 krb5kdc[29719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:25.863809 29878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.855076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50444 (local address 127.26.189.190:46651)
0806 02:17:25.855236 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:25.855240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:25.855255 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:17:25.855299 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:25.855302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:25.855344 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:25.855418 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:25.856135 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.856726 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.857638 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.857882 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.858009 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.860667 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:25.860670 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:25.860672 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:25.860699 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:25.862259 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.862645 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.862647 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.862648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.862725 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:25.862960 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:25.862962 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:25.862963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:25.863126 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:25.863242 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:25.863487 (+ 245us) server_negotiation.cc:299] Negotiation successful
0806 02:17:25.863610 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 02:17:25.867008 29798 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50444:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:17:25.870090 29798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:25.884835 30552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.878921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47646 (local address 127.26.189.131:46883)
0806 02:17:25.879683 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:25.879697 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:25.879723 (+ 26us) server_negotiation.cc:407] Connection header received
0806 02:17:25.879804 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:25.879809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:25.880036 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:25.880210 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:25.880572 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.881628 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.883341 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.884141 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.884316 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.884459 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:25.884581 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 02:17:25.884674 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":128,"threads_started":1}
I20260806 02:17:25.884827 30550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.878827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:46883 (local address 127.0.0.1:47646)
0806 02:17:25.879177 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:25.879236 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:25.879519 (+ 283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:25.880200 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:25.880209 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:25.880276 (+ 67us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:25.880432 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.880440 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.881760 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.881763 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.883182 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.883193 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.884287 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.884292 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.884403 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.884438 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 02:17:25.884553 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 02:17:25.884674 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":1,"spinlock_wait_cycles":384,"thread_start_us":97,"threads_started":1}
I20260806 02:17:25.885152 30553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.879576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:36543 (local address 127.0.0.1:59194)
0806 02:17:25.880472 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:25.880491 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:25.880605 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:25.881170 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:25.881173 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:25.881188 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:25.881336 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.881342 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.882443 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.882467 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.883530 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.883540 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.884734 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.884739 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.884851 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.884878 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 02:17:25.884942 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 02:17:25.885009 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":823,"mutex_wait_us":35,"thread_start_us":101,"threads_started":1}
I20260806 02:17:25.885504 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.878917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38051 (local address 127.0.0.1:57790)
0806 02:17:25.880181 (+ 1264us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:25.880195 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:25.880286 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:25.881009 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:25.881012 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:25.881030 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:25.881138 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.881144 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.882599 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.882602 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.883850 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:25.883860 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.885081 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.885084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:25.885202 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.885227 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 02:17:25.885308 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 02:17:25.885381 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1195,"mutex_wait_us":105,"spinlock_wait_cycles":4224,"thread_start_us":125,"threads_started":1}
I20260806 02:17:25.885886 30556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.879783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59194 (local address 127.26.189.130:36543)
0806 02:17:25.880649 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:25.880662 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:25.880682 (+ 20us) server_negotiation.cc:407] Connection header received
0806 02:17:25.880747 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:25.880751 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:25.880892 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:25.881023 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:25.881470 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.882323 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.883667 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.884393 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.884529 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.884650 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:25.885398 (+ 748us) server_negotiation.cc:299] Negotiation successful
0806 02:17:25.885488 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":127,"threads_started":1}
I20260806 02:17:25.886049 30558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:25.879831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57790 (local address 127.26.189.129:38051)
0806 02:17:25.880541 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:25.880549 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:25.880573 (+ 24us) server_negotiation.cc:407] Connection header received
0806 02:17:25.880650 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:25.880657 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:25.880859 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:25.881015 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:25.881265 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.882463 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.883986 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:25.884781 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:25.884894 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:25.885020 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:25.885767 (+ 747us) server_negotiation.cc:299] Negotiation successful
0806 02:17:25.885872 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":80,"threads_started":1}
I20260806 02:17:25.888315 30400 tablet_service.cc:1467] Processing CreateTablet for tablet 0d13135391e14664bd6f0f743d457d7c (DEFAULT_TABLE table=test-table [id=4ef3f55048e44f7da6c2049164c6dda9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:25.888788 30221 tablet_service.cc:1467] Processing CreateTablet for tablet 0d13135391e14664bd6f0f743d457d7c (DEFAULT_TABLE table=test-table [id=4ef3f55048e44f7da6c2049164c6dda9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:25.889423 30400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d13135391e14664bd6f0f743d457d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:25.889842 30221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d13135391e14664bd6f0f743d457d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:25.892110 29979 tablet_service.cc:1467] Processing CreateTablet for tablet 0d13135391e14664bd6f0f743d457d7c (DEFAULT_TABLE table=test-table [id=4ef3f55048e44f7da6c2049164c6dda9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:25.893108 29979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d13135391e14664bd6f0f743d457d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:25.896446 30559 tablet_bootstrap.cc:492] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e: Bootstrap starting.
I20260806 02:17:25.897899 30560 tablet_bootstrap.cc:492] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b: Bootstrap starting.
I20260806 02:17:25.898906 30559 tablet_bootstrap.cc:654] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:25.899662 30559 log.cc:824] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:25.900142 30560 tablet_bootstrap.cc:654] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:25.900959 30561 tablet_bootstrap.cc:492] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f: Bootstrap starting.
I20260806 02:17:25.901018 30560 log.cc:824] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:25.902127 30559 tablet_bootstrap.cc:492] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e: No bootstrap required, opened a new log
I20260806 02:17:25.902340 30559 ts_tablet_manager.cc:1397] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 02:17:25.903053 30560 tablet_bootstrap.cc:492] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b: No bootstrap required, opened a new log
I20260806 02:17:25.903043 30561 tablet_bootstrap.cc:654] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:25.903250 30560 ts_tablet_manager.cc:1397] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 02:17:25.903864 30561 log.cc:824] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:25.905804 30561 tablet_bootstrap.cc:492] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f: No bootstrap required, opened a new log
I20260806 02:17:25.905985 30561 ts_tablet_manager.cc:1397] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 02:17:25.905875 30559 raft_consensus.cc:348] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } }
I20260806 02:17:25.906179 30559 raft_consensus.cc:374] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:25.906256 30559 raft_consensus.cc:729] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd5e8ec31d64322ad8e349cdc3af42e, State: Initialized, Role: FOLLOWER
I20260806 02:17:25.906718 30559 consensus_queue.cc:260] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } }
I20260806 02:17:25.907059 30560 raft_consensus.cc:348] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } }
I20260806 02:17:25.907464 30560 raft_consensus.cc:374] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:25.907577 30560 raft_consensus.cc:729] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0da7131c50cb42d3a3464756e206110b, State: Initialized, Role: FOLLOWER
I20260806 02:17:25.907797 30559 ts_tablet_manager.cc:1428] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 02:17:25.908048 30560 consensus_queue.cc:260] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } }
I20260806 02:17:25.908175 30310 heartbeater.cc:503] Master 127.26.189.190:46651 was elected leader, sending a full tablet report...
I20260806 02:17:25.908821 30532 heartbeater.cc:503] Master 127.26.189.190:46651 was elected leader, sending a full tablet report...
I20260806 02:17:25.909101 30560 ts_tablet_manager.cc:1428] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:17:25.910431 30561 raft_consensus.cc:348] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } }
I20260806 02:17:25.910660 30561 raft_consensus.cc:374] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:25.910734 30561 raft_consensus.cc:729] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fc5fc08bce045e7a8ec76d0c697021f, State: Initialized, Role: FOLLOWER
I20260806 02:17:25.911149 30561 consensus_queue.cc:260] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } }
I20260806 02:17:25.911841 30108 heartbeater.cc:503] Master 127.26.189.190:46651 was elected leader, sending a full tablet report...
I20260806 02:17:25.912169 30561 ts_tablet_manager.cc:1428] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260806 02:17:26.057971 30109 tablet.cc:2369] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 02:17:26.059895 30311 tablet.cc:2369] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 02:17:26.071188 30533 tablet.cc:2369] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:17:26.089032 30572 raft_consensus.cc:482] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:26.089352 30572 raft_consensus.cc:504] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } }
I20260806 02:17:26.090705 30572 leader_election.cc:288] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883), abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543)
I20260806 02:17:26.094846 30556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.091187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:51685 (local address 127.26.189.130:36543)
0806 02:17:26.091326 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:26.091329 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:26.091634 (+ 305us) server_negotiation.cc:407] Connection header received
0806 02:17:26.091749 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:26.091752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:26.091799 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:26.091877 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:26.092206 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.092723 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.093889 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.094283 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.094417 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.094473 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:26.094647 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 02:17:26.094726 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 02:17:26.094871 30573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.091002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:36543 (local address 127.26.189.129:51685)
0806 02:17:26.091494 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:26.091505 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:26.091649 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:26.091899 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:26.091903 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:26.091919 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:26.092085 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.092090 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.092833 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.092838 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.093754 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.093764 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.094411 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.094415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.094518 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.094539 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 02:17:26.094630 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 02:17:26.094703 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":23,"thread_start_us":121,"threads_started":1}
I20260806 02:17:26.095014 30552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.091032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:54157 (local address 127.26.189.131:46883)
0806 02:17:26.091204 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:26.091209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:26.091487 (+ 278us) server_negotiation.cc:407] Connection header received
0806 02:17:26.091681 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:26.091685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:26.091732 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:26.091829 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:26.092193 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.092727 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.093920 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.094370 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.094520 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.094594 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:26.094784 (+ 190us) server_negotiation.cc:299] Negotiation successful
0806 02:17:26.094861 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 02:17:26.095350 30574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.090924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:46883 (local address 127.26.189.129:54157)
0806 02:17:26.091374 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:26.091388 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:26.091550 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:26.091842 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:26.091845 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:26.091862 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:26.092044 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.092074 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.092850 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.092857 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.093786 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.093797 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.094508 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.094512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.094629 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.094656 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 02:17:26.094764 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 02:17:26.094839 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":60,"thread_start_us":144,"threads_started":1}
I20260806 02:17:26.095889 30251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d13135391e14664bd6f0f743d457d7c" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" is_pre_election: true
I20260806 02:17:26.096242 30251 raft_consensus.cc:2454] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 0.
I20260806 02:17:26.096822 29936 leader_election.cc:302] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fc5fc08bce045e7a8ec76d0c697021f, abd5e8ec31d64322ad8e349cdc3af42e; no voters:
I20260806 02:17:26.097049 30454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d13135391e14664bd6f0f743d457d7c" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0da7131c50cb42d3a3464756e206110b" is_pre_election: true
I20260806 02:17:26.097139 30572 raft_consensus.cc:2781] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:26.097242 30572 raft_consensus.cc:482] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:26.097299 30572 raft_consensus.cc:3037] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:26.097391 30454 raft_consensus.cc:2454] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 0.
I20260806 02:17:26.098484 30572 raft_consensus.cc:504] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } }
I20260806 02:17:26.098796 30572 leader_election.cc:288] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 election: Requested vote from peers 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883), abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543)
I20260806 02:17:26.099160 30251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d13135391e14664bd6f0f743d457d7c" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd5e8ec31d64322ad8e349cdc3af42e"
I20260806 02:17:26.099268 30251 raft_consensus.cc:3037] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:26.100425 30251 raft_consensus.cc:2454] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 1.
I20260806 02:17:26.100715 30454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d13135391e14664bd6f0f743d457d7c" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0da7131c50cb42d3a3464756e206110b"
I20260806 02:17:26.100776 29936 leader_election.cc:302] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fc5fc08bce045e7a8ec76d0c697021f, abd5e8ec31d64322ad8e349cdc3af42e; no voters:
I20260806 02:17:26.100862 30454 raft_consensus.cc:3037] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:26.101013 30572 raft_consensus.cc:2781] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:26.101281 30572 raft_consensus.cc:686] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 LEADER]: Becoming Leader. State: Replica: 7fc5fc08bce045e7a8ec76d0c697021f, State: Running, Role: LEADER
I20260806 02:17:26.101692 30572 consensus_queue.cc:237] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } }
I20260806 02:17:26.102568 30454 raft_consensus.cc:2454] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 1.
I20260806 02:17:26.105420 29796 catalog_manager.cc:5495] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fc5fc08bce045e7a8ec76d0c697021f (127.26.189.129). New cstate: current_term: 1 leader_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } health_report { overall_health: UNKNOWN } } }
Aug 06 02:17:26 dist-test-slave-gkw7 krb5kdc[29719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982644, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:26.140758 30585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.131442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:46651 (local address 127.0.0.1:50448)
0806 02:17:26.131834 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:26.131846 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:26.131992 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:26.132281 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:26.132284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:26.132741 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:26.132840 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.132846 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.133707 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.133712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.134283 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.134291 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.134761 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.134764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.134884 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.135567 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:26.135580 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:26.137118 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:26.139008 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:26.139022 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:26.139030 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:26.139280 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:26.139571 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:26.139576 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:26.139579 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:26.139664 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:26.140086 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:26.140096 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:26.140216 (+ 120us) client_negotiation.cc:769] Sending connection context
0806 02:17:26.140348 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 02:17:26.140545 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":22,"thread_start_us":133,"threads_started":1}
I20260806 02:17:26.140756 29878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.131563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50448 (local address 127.26.189.190:46651)
0806 02:17:26.131741 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:26.131746 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:26.131939 (+ 193us) server_negotiation.cc:407] Connection header received
0806 02:17:26.132103 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:26.132106 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:26.132154 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:26.132250 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:26.132968 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.133523 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.134418 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.134638 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.134749 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.137275 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:26.137278 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:26.137280 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:26.137301 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:26.138887 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:26.139393 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:26.139396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:26.139398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:26.139478 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:26.139776 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:26.139779 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:26.139781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:26.139974 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:26.140086 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:26.140399 (+ 313us) server_negotiation.cc:299] Negotiation successful
0806 02:17:26.140613 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":121,"server-negotiator.queue_time_us":59}
I20260806 02:17:26.145334 29796 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:50448:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 02:17:26.146167 29796 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:26.151643 30400 tablet_service.cc:1467] Processing CreateTablet for tablet 84ca1c2e2b6041eda711d559478667ee (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4cb4408702f447ac9c216500d9b792c4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 02:17:26.151595 29979 tablet_service.cc:1467] Processing CreateTablet for tablet 84ca1c2e2b6041eda711d559478667ee (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4cb4408702f447ac9c216500d9b792c4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 02:17:26.151594 30221 tablet_service.cc:1467] Processing CreateTablet for tablet 84ca1c2e2b6041eda711d559478667ee (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4cb4408702f447ac9c216500d9b792c4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 02:17:26.152335 30400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84ca1c2e2b6041eda711d559478667ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:26.152343 30221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84ca1c2e2b6041eda711d559478667ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:26.152343 29979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84ca1c2e2b6041eda711d559478667ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:26.155130 30560 tablet_bootstrap.cc:492] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b: Bootstrap starting.
I20260806 02:17:26.155402 30559 tablet_bootstrap.cc:492] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: Bootstrap starting.
I20260806 02:17:26.156265 30560 tablet_bootstrap.cc:654] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:26.156349 30559 tablet_bootstrap.cc:654] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:26.157004 30561 tablet_bootstrap.cc:492] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f: Bootstrap starting.
I20260806 02:17:26.157778 30560 tablet_bootstrap.cc:492] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b: No bootstrap required, opened a new log
I20260806 02:17:26.157780 30559 tablet_bootstrap.cc:492] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: No bootstrap required, opened a new log
I20260806 02:17:26.157874 30560 ts_tablet_manager.cc:1397] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 02:17:26.157874 30559 ts_tablet_manager.cc:1397] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 02:17:26.158097 30561 tablet_bootstrap.cc:654] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:26.158357 30559 raft_consensus.cc:348] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.158356 30560 raft_consensus.cc:348] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.158485 30559 raft_consensus.cc:374] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:26.158485 30560 raft_consensus.cc:374] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:26.158521 30559 raft_consensus.cc:729] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd5e8ec31d64322ad8e349cdc3af42e, State: Initialized, Role: FOLLOWER
I20260806 02:17:26.158521 30560 raft_consensus.cc:729] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0da7131c50cb42d3a3464756e206110b, State: Initialized, Role: FOLLOWER
I20260806 02:17:26.158653 30559 consensus_queue.cc:260] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.158679 30560 consensus_queue.cc:260] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.158931 30560 ts_tablet_manager.cc:1428] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 02:17:26.158931 30559 ts_tablet_manager.cc:1428] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:26.159375 30568 tablet_replica.cc:439] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } }
I20260806 02:17:26.159546 30568 tablet_replica.cc:442] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:26.159775 30570 tablet_replica.cc:439] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } }
I20260806 02:17:26.159935 30570 tablet_replica.cc:442] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:26.161051 30561 tablet_bootstrap.cc:492] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f: No bootstrap required, opened a new log
I20260806 02:17:26.161160 30561 ts_tablet_manager.cc:1397] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260806 02:17:26.161819 30561 raft_consensus.cc:348] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.161952 30561 raft_consensus.cc:374] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:26.161989 30561 raft_consensus.cc:729] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fc5fc08bce045e7a8ec76d0c697021f, State: Initialized, Role: FOLLOWER
I20260806 02:17:26.162114 30561 consensus_queue.cc:260] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.162411 30561 ts_tablet_manager.cc:1428] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 02:17:26.162353 30572 tablet_replica.cc:439] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } }
I20260806 02:17:26.162504 30572 tablet_replica.cc:442] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:26.173687 30568 raft_consensus.cc:482] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:26.173834 30568 raft_consensus.cc:504] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.175395 30568 leader_election.cc:288] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fc5fc08bce045e7a8ec76d0c697021f (127.26.189.129:38051), 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883)
I20260806 02:17:26.180105 30558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.175691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:46245 (local address 127.26.189.129:38051)
0806 02:17:26.175834 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:26.175841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:26.176084 (+ 243us) server_negotiation.cc:407] Connection header received
0806 02:17:26.176263 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:26.176266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:26.176317 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:26.176407 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:26.176882 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.177473 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.178944 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.179491 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.179611 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.179665 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:26.179863 (+ 198us) server_negotiation.cc:299] Negotiation successful
0806 02:17:26.179960 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 02:17:26.180281 30591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.175600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38051 (local address 127.26.189.130:46245)
0806 02:17:26.175984 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:26.176000 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:26.176120 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:26.176434 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:26.176437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:26.176481 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:26.176765 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.176773 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.177626 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.177629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.178775 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.178786 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.179635 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.179638 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.179726 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.179747 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 02:17:26.179813 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 02:17:26.179870 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":87,"spinlock_wait_cycles":6144,"thread_start_us":128,"threads_started":1}
I20260806 02:17:26.180501 30589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.175622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:46883 (local address 127.26.189.130:55237)
0806 02:17:26.176053 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:26.176067 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:26.176142 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:26.176434 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:26.176437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:26.176479 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:26.177249 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.177257 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.178102 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.178106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.179165 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.179173 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.179990 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.179994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.180085 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.180106 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 02:17:26.180185 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 02:17:26.180257 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"mutex_wait_us":66,"spinlock_wait_cycles":39680,"thread_start_us":91,"threads_started":1}
I20260806 02:17:26.180505 30552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.175766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:55237 (local address 127.26.189.131:46883)
0806 02:17:26.175897 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:26.175900 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:26.176137 (+ 237us) server_negotiation.cc:407] Connection header received
0806 02:17:26.176262 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:26.176265 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:26.176317 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:26.176407 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:26.177378 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.177989 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.179281 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.179866 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.179982 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.180025 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:26.180303 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 02:17:26.180386 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 02:17:26.180909 30454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84ca1c2e2b6041eda711d559478667ee" candidate_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0da7131c50cb42d3a3464756e206110b" is_pre_election: true
I20260806 02:17:26.180914 30040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84ca1c2e2b6041eda711d559478667ee" candidate_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" is_pre_election: true
I20260806 02:17:26.181095 30454 raft_consensus.cc:2454] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd5e8ec31d64322ad8e349cdc3af42e in term 0.
I20260806 02:17:26.181200 30040 raft_consensus.cc:2454] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd5e8ec31d64322ad8e349cdc3af42e in term 0.
I20260806 02:17:26.181504 30148 leader_election.cc:302] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0da7131c50cb42d3a3464756e206110b, abd5e8ec31d64322ad8e349cdc3af42e; no voters:
I20260806 02:17:26.181851 30568 raft_consensus.cc:2781] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:26.181908 30568 raft_consensus.cc:482] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:26.181936 30568 raft_consensus.cc:3037] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:26.182968 30568 raft_consensus.cc:504] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.183339 30568 leader_election.cc:288] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [CANDIDATE]: Term 1 election: Requested vote from peers 7fc5fc08bce045e7a8ec76d0c697021f (127.26.189.129:38051), 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883)
I20260806 02:17:26.183771 30454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84ca1c2e2b6041eda711d559478667ee" candidate_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0da7131c50cb42d3a3464756e206110b"
I20260806 02:17:26.183881 30454 raft_consensus.cc:3037] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:26.184912 30454 raft_consensus.cc:2454] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd5e8ec31d64322ad8e349cdc3af42e in term 1.
I20260806 02:17:26.185212 30148 leader_election.cc:302] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0da7131c50cb42d3a3464756e206110b, abd5e8ec31d64322ad8e349cdc3af42e; no voters:
I20260806 02:17:26.185200 30040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84ca1c2e2b6041eda711d559478667ee" candidate_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fc5fc08bce045e7a8ec76d0c697021f"
I20260806 02:17:26.185328 30040 raft_consensus.cc:3037] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:26.185402 30568 raft_consensus.cc:2781] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:26.185652 30568 raft_consensus.cc:686] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [term 1 LEADER]: Becoming Leader. State: Replica: abd5e8ec31d64322ad8e349cdc3af42e, State: Running, Role: LEADER
I20260806 02:17:26.186019 30568 consensus_queue.cc:237] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.186583 30040 raft_consensus.cc:2454] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd5e8ec31d64322ad8e349cdc3af42e in term 1.
I20260806 02:17:26.188719 30592 tablet_replica.cc:439] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: TxnStatusTablet state changed. Reason: New leader abd5e8ec31d64322ad8e349cdc3af42e. Latest consensus state: current_term: 1 leader_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } }
I20260806 02:17:26.188834 30592 tablet_replica.cc:442] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: This TxnStatusTablet replica's current role is: LEADER
I20260806 02:17:26.189133 30594 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 02:17:26.189365 30594 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 02:17:26.189906 29796 catalog_manager.cc:5495] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e reported cstate change: term changed from 0 to 1, leader changed from <none> to abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130). New cstate: current_term: 1 leader_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } health_report { overall_health: UNKNOWN } } }
I20260806 02:17:26.210870 30556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.206744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36216 (local address 127.26.189.130:36543)
0806 02:17:26.206879 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:26.206884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:26.206897 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:17:26.207049 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:26.207052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:26.207141 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:26.207228 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:26.207500 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.207994 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.209236 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.209456 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.209607 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.209911 (+ 304us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:26.210376 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:26.210528 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:26.210633 (+ 105us) server_negotiation.cc:299] Negotiation successful
0806 02:17:26.210686 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 02:17:26.210847 30585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.206643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:36543 (local address 127.0.0.1:36216)
0806 02:17:26.206788 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:26.206807 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:26.206920 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:26.207271 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:26.207274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:26.207282 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 02:17:26.207395 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.207400 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.208096 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.208099 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.209112 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.209123 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.209604 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.209607 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.209702 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.209766 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 02:17:26.210501 (+ 735us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 02:17:26.210519 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 02:17:26.210618 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 02:17:26.210704 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 02:17:26.216583 30040 raft_consensus.cc:1261] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Refusing update from remote peer abd5e8ec31d64322ad8e349cdc3af42e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:26.216606 30454 raft_consensus.cc:1261] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Refusing update from remote peer abd5e8ec31d64322ad8e349cdc3af42e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:26.217350 30592 consensus_queue.cc:1035] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:26.217588 30568 consensus_queue.cc:1035] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:26.220892 30572 tablet_replica.cc:439] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f: TxnStatusTablet state changed. Reason: New leader abd5e8ec31d64322ad8e349cdc3af42e. Latest consensus state: current_term: 1 leader_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } }
I20260806 02:17:26.221020 30572 tablet_replica.cc:442] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:26.221920 30570 tablet_replica.cc:439] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b: TxnStatusTablet state changed. Reason: New leader abd5e8ec31d64322ad8e349cdc3af42e. Latest consensus state: current_term: 1 leader_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } }
I20260806 02:17:26.222040 30570 tablet_replica.cc:442] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:26.224255 30592 tablet_replica.cc:439] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } }
I20260806 02:17:26.224383 30592 tablet_replica.cc:442] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: This TxnStatusTablet replica's current role is: LEADER
I20260806 02:17:26.226483 30572 tablet_replica.cc:439] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } }
I20260806 02:17:26.226596 30572 tablet_replica.cc:442] T 84ca1c2e2b6041eda711d559478667ee P 7fc5fc08bce045e7a8ec76d0c697021f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:26.228214 30568 tablet_replica.cc:439] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } }
I20260806 02:17:26.228327 30568 tablet_replica.cc:442] T 84ca1c2e2b6041eda711d559478667ee P abd5e8ec31d64322ad8e349cdc3af42e: This TxnStatusTablet replica's current role is: LEADER
I20260806 02:17:26.232681 30570 tablet_replica.cc:439] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } } }
I20260806 02:17:26.232827 30570 tablet_replica.cc:442] T 84ca1c2e2b6041eda711d559478667ee P 0da7131c50cb42d3a3464756e206110b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:26.236464 30558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.231877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32986 (local address 127.26.189.129:38051)
0806 02:17:26.232115 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:26.232120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:26.232135 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:17:26.232214 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:26.232217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:26.232284 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:26.232417 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:26.232754 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.233469 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.234835 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.235149 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.235250 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.235647 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:26.236055 (+ 408us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:26.236200 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:26.236264 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 02:17:26.236322 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
I20260806 02:17:26.248059 30556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.244082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:42781 (local address 127.26.189.130:36543)
0806 02:17:26.244245 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:26.244249 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:26.244531 (+ 282us) server_negotiation.cc:407] Connection header received
0806 02:17:26.244678 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:26.244680 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:26.244727 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:26.244792 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:26.245084 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.245745 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.247004 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.247223 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.247311 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.247657 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:26.247726 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:26.247781 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:26.247905 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 02:17:26.247950 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 02:17:26.248138 30622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.243987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:36543 (local address 127.26.189.129:42781)
0806 02:17:26.244435 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:26.244452 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:26.244555 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:26.244830 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:26.244833 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:26.244841 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 02:17:26.244974 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.244980 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.245850 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.245854 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.246877 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.246888 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.247338 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.247342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.247443 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.247497 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 02:17:26.247810 (+ 313us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 02:17:26.247817 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 02:17:26.247884 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 02:17:26.247965 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":114,"threads_started":1}
I20260806 02:17:26.255968 30454 raft_consensus.cc:1261] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Refusing update from remote peer 7fc5fc08bce045e7a8ec76d0c697021f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:26.256248 30251 raft_consensus.cc:1261] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Refusing update from remote peer 7fc5fc08bce045e7a8ec76d0c697021f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:26.256846 30575 consensus_queue.cc:1035] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:26.257107 30572 consensus_queue.cc:1035] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:26.260371 30604 mvcc.cc:205] Tried to move back new op lower bound from 7315384919059361792 to 7315384918436028416. Current Snapshot: MvccSnapshot[applied={T|T < 7315384919059361792}]
I20260806 02:17:26.262305 30598 mvcc.cc:205] Tried to move back new op lower bound from 7315384919059361792 to 7315384918436028416. Current Snapshot: MvccSnapshot[applied={T|T < 7315384919059361792}]
I20260806 02:17:26.265126 30603 mvcc.cc:205] Tried to move back new op lower bound from 7315384919059361792 to 7315384918436028416. Current Snapshot: MvccSnapshot[applied={T|T < 7315384919059361792}]
I20260806 02:17:26.281767 30631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.277112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38051 (local address 127.26.189.130:37601)
0806 02:17:26.277636 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:26.277676 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:26.277799 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:26.278309 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:26.278311 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:26.278318 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 02:17:26.278440 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.278444 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.279462 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.279466 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.280436 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:26.280444 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.280919 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.280923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:26.281021 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.281083 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 02:17:26.281423 (+ 340us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 02:17:26.281432 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 02:17:26.281496 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 02:17:26.281602 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":128,"threads_started":1}
I20260806 02:17:26.281747 30558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:26.277164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:37601 (local address 127.26.189.129:38051)
0806 02:17:26.277290 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:26.277295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:26.277772 (+ 477us) server_negotiation.cc:407] Connection header received
0806 02:17:26.278141 (+ 369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:26.278144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:26.278200 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:26.278286 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:26.278549 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.279315 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.280559 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:26.280805 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:26.280918 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:26.281246 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:26.281334 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:26.281418 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:26.281516 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 02:17:26.281603 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 02:17:26.304148 29798 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:26.304358 29798 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:26.307211 29798 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714: Sending DeleteTablet for 3 replicas of tablet 0d13135391e14664bd6f0f743d457d7c
I20260806 02:17:26.307988 30400 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d13135391e14664bd6f0f743d457d7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:26 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:47646
I20260806 02:17:26.308712 29979 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d13135391e14664bd6f0f743d457d7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:26 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:57790
I20260806 02:17:26.309092 30221 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d13135391e14664bd6f0f743d457d7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:26 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:59194
I20260806 02:17:26.309979 30635 tablet_replica.cc:330] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b: stopping tablet replica
I20260806 02:17:26.310382 30635 raft_consensus.cc:2229] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:26.310622 30635 raft_consensus.cc:2258] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:26.310870 29798 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50444:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:17:26.311312 29798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:26.316982 30221 tablet_service.cc:1467] Processing CreateTablet for tablet 90cdd6d52f364943b497f5f0dfa5e979 (DEFAULT_TABLE table=test-table [id=31748917fa50447980b07c0369386c1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:26.317319 30221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90cdd6d52f364943b497f5f0dfa5e979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:26.320039 30400 tablet_service.cc:1467] Processing CreateTablet for tablet 90cdd6d52f364943b497f5f0dfa5e979 (DEFAULT_TABLE table=test-table [id=31748917fa50447980b07c0369386c1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:26.320396 30400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90cdd6d52f364943b497f5f0dfa5e979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:26.322522 30636 tablet_replica.cc:330] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f: stopping tablet replica
I20260806 02:17:26.322822 30559 tablet_bootstrap.cc:492] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e: Bootstrap starting.
I20260806 02:17:26.322980 30636 raft_consensus.cc:2229] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:17:26.323443 30636 raft_consensus.cc:2258] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:26.323822 30559 tablet_bootstrap.cc:654] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:26.324072 30637 tablet_replica.cc:330] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e: stopping tablet replica
I20260806 02:17:26.324537 30560 tablet_bootstrap.cc:492] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b: Bootstrap starting.
I20260806 02:17:26.325066 30637 raft_consensus.cc:2229] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:26.325481 30560 tablet_bootstrap.cc:654] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:26.325747 30637 raft_consensus.cc:2258] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:26.326542 30636 ts_tablet_manager.cc:1905] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:26.326787 29979 tablet_service.cc:1467] Processing CreateTablet for tablet 90cdd6d52f364943b497f5f0dfa5e979 (DEFAULT_TABLE table=test-table [id=31748917fa50447980b07c0369386c1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:26.327057 29979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90cdd6d52f364943b497f5f0dfa5e979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:26.328123 30637 ts_tablet_manager.cc:1905] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:26.329629 30561 tablet_bootstrap.cc:492] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f: Bootstrap starting.
I20260806 02:17:26.330627 30561 tablet_bootstrap.cc:654] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:26.331200 30635 ts_tablet_manager.cc:1905] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:26.331664 30559 tablet_bootstrap.cc:492] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e: No bootstrap required, opened a new log
I20260806 02:17:26.331769 30559 ts_tablet_manager.cc:1397] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260806 02:17:26.332266 30559 raft_consensus.cc:348] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.332424 30559 raft_consensus.cc:374] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:26.332471 30559 raft_consensus.cc:729] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd5e8ec31d64322ad8e349cdc3af42e, State: Initialized, Role: FOLLOWER
I20260806 02:17:26.332635 30559 consensus_queue.cc:260] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.332947 30559 ts_tablet_manager.cc:1428] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:26.336017 30560 tablet_bootstrap.cc:492] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b: No bootstrap required, opened a new log
I20260806 02:17:26.336151 30560 ts_tablet_manager.cc:1397] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260806 02:17:26.336671 30560 raft_consensus.cc:348] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.336833 30560 raft_consensus.cc:374] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:26.336874 30560 raft_consensus.cc:729] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0da7131c50cb42d3a3464756e206110b, State: Initialized, Role: FOLLOWER
I20260806 02:17:26.337018 30560 consensus_queue.cc:260] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.337291 30560 ts_tablet_manager.cc:1428] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 02:17:26.337484 30636 ts_tablet_manager.cc:1918] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:26.337647 30636 log.cc:1196] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/wal/wals/0d13135391e14664bd6f0f743d457d7c
I20260806 02:17:26.338328 30561 tablet_bootstrap.cc:492] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f: No bootstrap required, opened a new log
I20260806 02:17:26.336658 30635 ts_tablet_manager.cc:1918] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:26.338429 30561 ts_tablet_manager.cc:1397] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260806 02:17:26.338443 30635 log.cc:1196] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/0d13135391e14664bd6f0f743d457d7c
I20260806 02:17:26.338801 30635 ts_tablet_manager.cc:1939] T 0d13135391e14664bd6f0f743d457d7c P 0da7131c50cb42d3a3464756e206110b: Deleting consensus metadata
I20260806 02:17:26.338973 30561 raft_consensus.cc:348] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.339115 30561 raft_consensus.cc:374] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:26.339177 30561 raft_consensus.cc:729] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fc5fc08bce045e7a8ec76d0c697021f, State: Initialized, Role: FOLLOWER
I20260806 02:17:26.339332 30561 consensus_queue.cc:260] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.339670 30561 ts_tablet_manager.cc:1428] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:26.339844 30637 ts_tablet_manager.cc:1918] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:26.340135 29772 catalog_manager.cc:4841] TS 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883): tablet 0d13135391e14664bd6f0f743d457d7c (table test-table [id=4ef3f55048e44f7da6c2049164c6dda9]) successfully deleted
I20260806 02:17:26.340349 30637 log.cc:1196] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/0d13135391e14664bd6f0f743d457d7c
I20260806 02:17:26.340664 30636 ts_tablet_manager.cc:1939] T 0d13135391e14664bd6f0f743d457d7c P 7fc5fc08bce045e7a8ec76d0c697021f: Deleting consensus metadata
I20260806 02:17:26.341733 30637 ts_tablet_manager.cc:1939] T 0d13135391e14664bd6f0f743d457d7c P abd5e8ec31d64322ad8e349cdc3af42e: Deleting consensus metadata
I20260806 02:17:26.342031 29770 catalog_manager.cc:4841] TS 7fc5fc08bce045e7a8ec76d0c697021f (127.26.189.129:38051): tablet 0d13135391e14664bd6f0f743d457d7c (table test-table [id=4ef3f55048e44f7da6c2049164c6dda9]) successfully deleted
I20260806 02:17:26.345652 29770 catalog_manager.cc:4841] TS abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543): tablet 0d13135391e14664bd6f0f743d457d7c (table test-table [id=4ef3f55048e44f7da6c2049164c6dda9]) successfully deleted
I20260806 02:17:26.381500 30627 raft_consensus.cc:482] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:26.381712 30627 raft_consensus.cc:504] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.382225 30627 leader_election.cc:288] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543), 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883)
I20260806 02:17:26.382807 30454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cdd6d52f364943b497f5f0dfa5e979" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0da7131c50cb42d3a3464756e206110b" is_pre_election: true
I20260806 02:17:26.382983 30454 raft_consensus.cc:2454] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 0.
I20260806 02:17:26.383076 30251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cdd6d52f364943b497f5f0dfa5e979" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" is_pre_election: true
I20260806 02:17:26.383245 30251 raft_consensus.cc:2454] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 0.
I20260806 02:17:26.383427 29939 leader_election.cc:302] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0da7131c50cb42d3a3464756e206110b, 7fc5fc08bce045e7a8ec76d0c697021f; no voters:
I20260806 02:17:26.383627 30627 raft_consensus.cc:2781] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:26.383687 30627 raft_consensus.cc:482] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:26.383735 30627 raft_consensus.cc:3037] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:26.384908 30627 raft_consensus.cc:504] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.385341 30627 leader_election.cc:288] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 election: Requested vote from peers abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543), 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883)
I20260806 02:17:26.385712 30251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cdd6d52f364943b497f5f0dfa5e979" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd5e8ec31d64322ad8e349cdc3af42e"
I20260806 02:17:26.385775 30454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cdd6d52f364943b497f5f0dfa5e979" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0da7131c50cb42d3a3464756e206110b"
I20260806 02:17:26.385841 30251 raft_consensus.cc:3037] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:26.385888 30454 raft_consensus.cc:3037] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:26.387102 30251 raft_consensus.cc:2454] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 1.
I20260806 02:17:26.387110 30454 raft_consensus.cc:2454] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 1.
I20260806 02:17:26.387605 29936 leader_election.cc:302] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fc5fc08bce045e7a8ec76d0c697021f, abd5e8ec31d64322ad8e349cdc3af42e; no voters:
I20260806 02:17:26.387773 30627 raft_consensus.cc:2781] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:26.387866 30627 raft_consensus.cc:686] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 LEADER]: Becoming Leader. State: Replica: 7fc5fc08bce045e7a8ec76d0c697021f, State: Running, Role: LEADER
I20260806 02:17:26.388022 30627 consensus_queue.cc:237] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:26.389899 29798 catalog_manager.cc:5495] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fc5fc08bce045e7a8ec76d0c697021f (127.26.189.129). New cstate: current_term: 1 leader_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } health_report { overall_health: UNKNOWN } } }
I20260806 02:17:26.410944 30251 raft_consensus.cc:1261] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Refusing update from remote peer 7fc5fc08bce045e7a8ec76d0c697021f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:26.411418 30572 consensus_queue.cc:1035] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:26.412117 30454 raft_consensus.cc:1261] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Refusing update from remote peer 7fc5fc08bce045e7a8ec76d0c697021f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:26.412540 30627 consensus_queue.cc:1035] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 02:17:26.427421 30604 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 02:17:27.984148 29796 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:27.984306 29796 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:27.986766 29796 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714: Sending DeleteTablet for 3 replicas of tablet 90cdd6d52f364943b497f5f0dfa5e979
I20260806 02:17:27.987440 30400 tablet_service.cc:1514] Processing DeleteTablet for tablet 90cdd6d52f364943b497f5f0dfa5e979 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:27 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:47646
I20260806 02:17:27.987504 29979 tablet_service.cc:1514] Processing DeleteTablet for tablet 90cdd6d52f364943b497f5f0dfa5e979 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:27 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:57790
I20260806 02:17:27.987589 30221 tablet_service.cc:1514] Processing DeleteTablet for tablet 90cdd6d52f364943b497f5f0dfa5e979 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:27 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:59194
I20260806 02:17:27.987885 30678 tablet_replica.cc:330] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b: stopping tablet replica
I20260806 02:17:27.987948 30680 tablet_replica.cc:330] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e: stopping tablet replica
I20260806 02:17:27.988068 30678 raft_consensus.cc:2229] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:27.988085 30680 raft_consensus.cc:2229] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:27.988224 30678 raft_consensus.cc:2258] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:27.988255 30680 raft_consensus.cc:2258] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:27.988888 30680 ts_tablet_manager.cc:1905] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:27.989020 30678 ts_tablet_manager.cc:1905] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:27.989725 30679 tablet_replica.cc:330] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f: stopping tablet replica
I20260806 02:17:27.989912 30679 raft_consensus.cc:2229] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:17:27.990185 30679 raft_consensus.cc:2258] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:27.990918 30679 ts_tablet_manager.cc:1905] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:27.991822 30680 ts_tablet_manager.cc:1918] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 02:17:27.991954 30680 log.cc:1196] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/90cdd6d52f364943b497f5f0dfa5e979
I20260806 02:17:27.992256 30678 ts_tablet_manager.cc:1918] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 02:17:27.992311 30680 ts_tablet_manager.cc:1939] T 90cdd6d52f364943b497f5f0dfa5e979 P abd5e8ec31d64322ad8e349cdc3af42e: Deleting consensus metadata
I20260806 02:17:27.992394 30678 log.cc:1196] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/90cdd6d52f364943b497f5f0dfa5e979
I20260806 02:17:27.992730 30678 ts_tablet_manager.cc:1939] T 90cdd6d52f364943b497f5f0dfa5e979 P 0da7131c50cb42d3a3464756e206110b: Deleting consensus metadata
I20260806 02:17:27.993193 29770 catalog_manager.cc:4841] TS abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543): tablet 90cdd6d52f364943b497f5f0dfa5e979 (table test-table [id=31748917fa50447980b07c0369386c1b]) successfully deleted
I20260806 02:17:27.993521 29772 catalog_manager.cc:4841] TS 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883): tablet 90cdd6d52f364943b497f5f0dfa5e979 (table test-table [id=31748917fa50447980b07c0369386c1b]) successfully deleted
I20260806 02:17:27.993914 30679 ts_tablet_manager.cc:1918] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 02:17:27.994010 30679 log.cc:1196] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/wal/wals/90cdd6d52f364943b497f5f0dfa5e979
I20260806 02:17:27.994289 30679 ts_tablet_manager.cc:1939] T 90cdd6d52f364943b497f5f0dfa5e979 P 7fc5fc08bce045e7a8ec76d0c697021f: Deleting consensus metadata
I20260806 02:17:27.994948 29770 catalog_manager.cc:4841] TS 7fc5fc08bce045e7a8ec76d0c697021f (127.26.189.129:38051): tablet 90cdd6d52f364943b497f5f0dfa5e979 (table test-table [id=31748917fa50447980b07c0369386c1b]) successfully deleted
Aug 06 02:17:27 dist-test-slave-gkw7 krb5kdc[29719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982647, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 02:17:28 dist-test-slave-gkw7 krb5kdc[29719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982647, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:28.022475 30692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:28.009669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47116 (local address 127.26.189.190:46651)
0806 02:17:28.009942 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:28.009948 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:28.009964 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:17:28.010097 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:28.010099 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:28.010201 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:28.010287 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:28.011044 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:28.011645 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:28.012573 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:28.012820 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:28.012917 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:28.018979 (+ 6062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:28.018983 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:28.018985 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:28.019018 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:28.020571 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:28.021033 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:28.021037 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:28.021039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:28.021129 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:28.021439 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:28.021443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:28.021444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:28.021729 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:28.021884 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:28.022143 (+ 259us) server_negotiation.cc:299] Negotiation successful
0806 02:17:28.022283 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":114,"threads_started":1}
I20260806 02:17:28.025413 29796 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:17:28.025906 29796 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:28.030833 30221 tablet_service.cc:1467] Processing CreateTablet for tablet adcff6c949384128a5b0a393d3a2c36f (DEFAULT_TABLE table=test-table [id=c18c920c123b4d2d8572fa056e71eed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:28.030812 29979 tablet_service.cc:1467] Processing CreateTablet for tablet adcff6c949384128a5b0a393d3a2c36f (DEFAULT_TABLE table=test-table [id=c18c920c123b4d2d8572fa056e71eed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:28.030911 30400 tablet_service.cc:1467] Processing CreateTablet for tablet adcff6c949384128a5b0a393d3a2c36f (DEFAULT_TABLE table=test-table [id=c18c920c123b4d2d8572fa056e71eed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:28.031167 30221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adcff6c949384128a5b0a393d3a2c36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:28.031172 29979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adcff6c949384128a5b0a393d3a2c36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:28.031174 30400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adcff6c949384128a5b0a393d3a2c36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:28.033275 30694 tablet_bootstrap.cc:492] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e: Bootstrap starting.
I20260806 02:17:28.033743 30696 tablet_bootstrap.cc:492] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f: Bootstrap starting.
I20260806 02:17:28.034360 30694 tablet_bootstrap.cc:654] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:28.034778 30696 tablet_bootstrap.cc:654] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:28.035192 30695 tablet_bootstrap.cc:492] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b: Bootstrap starting.
I20260806 02:17:28.035653 30694 tablet_bootstrap.cc:492] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e: No bootstrap required, opened a new log
I20260806 02:17:28.035766 30694 ts_tablet_manager.cc:1397] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 02:17:28.036185 30694 raft_consensus.cc:348] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.036284 30694 raft_consensus.cc:374] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:28.036350 30694 raft_consensus.cc:729] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd5e8ec31d64322ad8e349cdc3af42e, State: Initialized, Role: FOLLOWER
I20260806 02:17:28.036490 30694 consensus_queue.cc:260] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.036823 30694 ts_tablet_manager.cc:1428] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:28.038432 30695 tablet_bootstrap.cc:654] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:28.038760 30696 tablet_bootstrap.cc:492] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f: No bootstrap required, opened a new log
I20260806 02:17:28.038875 30696 ts_tablet_manager.cc:1397] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 02:17:28.039314 30696 raft_consensus.cc:348] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.039485 30696 raft_consensus.cc:374] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:28.039570 30696 raft_consensus.cc:729] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fc5fc08bce045e7a8ec76d0c697021f, State: Initialized, Role: FOLLOWER
I20260806 02:17:28.040115 30695 tablet_bootstrap.cc:492] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b: No bootstrap required, opened a new log
I20260806 02:17:28.039934 30696 consensus_queue.cc:260] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.040373 30695 ts_tablet_manager.cc:1397] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 02:17:28.040402 30696 ts_tablet_manager.cc:1428] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 02:17:28.040889 30695 raft_consensus.cc:348] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.041009 30695 raft_consensus.cc:374] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:28.041033 30695 raft_consensus.cc:729] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0da7131c50cb42d3a3464756e206110b, State: Initialized, Role: FOLLOWER
I20260806 02:17:28.041167 30695 consensus_queue.cc:260] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.041600 30695 ts_tablet_manager.cc:1428] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:28.203680 30669 raft_consensus.cc:482] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:28.203883 30669 raft_consensus.cc:504] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.204448 30669 leader_election.cc:288] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543), 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883)
I20260806 02:17:28.205034 30454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adcff6c949384128a5b0a393d3a2c36f" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0da7131c50cb42d3a3464756e206110b" is_pre_election: true
I20260806 02:17:28.205214 30454 raft_consensus.cc:2454] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 0.
I20260806 02:17:28.205329 30251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adcff6c949384128a5b0a393d3a2c36f" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" is_pre_election: true
I20260806 02:17:28.205593 30251 raft_consensus.cc:2454] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 0.
I20260806 02:17:28.205678 29939 leader_election.cc:302] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0da7131c50cb42d3a3464756e206110b, 7fc5fc08bce045e7a8ec76d0c697021f; no voters:
I20260806 02:17:28.205895 30669 raft_consensus.cc:2781] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:28.205968 30669 raft_consensus.cc:482] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:28.206022 30669 raft_consensus.cc:3037] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:28.207079 30669 raft_consensus.cc:504] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.207453 30669 leader_election.cc:288] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 election: Requested vote from peers abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543), 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883)
I20260806 02:17:28.207840 30454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adcff6c949384128a5b0a393d3a2c36f" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0da7131c50cb42d3a3464756e206110b"
I20260806 02:17:28.207998 30454 raft_consensus.cc:3037] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:28.207914 30251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adcff6c949384128a5b0a393d3a2c36f" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd5e8ec31d64322ad8e349cdc3af42e"
I20260806 02:17:28.208098 30251 raft_consensus.cc:3037] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:28.209379 30454 raft_consensus.cc:2454] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 1.
I20260806 02:17:28.209694 30251 raft_consensus.cc:2454] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 1.
I20260806 02:17:28.209807 29939 leader_election.cc:302] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0da7131c50cb42d3a3464756e206110b, 7fc5fc08bce045e7a8ec76d0c697021f; no voters:
I20260806 02:17:28.210134 30669 raft_consensus.cc:2781] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:28.210255 30669 raft_consensus.cc:686] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 LEADER]: Becoming Leader. State: Replica: 7fc5fc08bce045e7a8ec76d0c697021f, State: Running, Role: LEADER
I20260806 02:17:28.210407 30669 consensus_queue.cc:237] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.212494 29796 catalog_manager.cc:5495] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fc5fc08bce045e7a8ec76d0c697021f (127.26.189.129). New cstate: current_term: 1 leader_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } health_report { overall_health: UNKNOWN } } }
I20260806 02:17:28.238786 30709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:28.235260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33000 (local address 127.26.189.129:38051)
0806 02:17:28.235550 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:28.235557 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:28.235571 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:17:28.235613 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:28.235616 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:28.235657 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:28.235740 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:28.236096 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:28.236641 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:28.237728 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:28.237975 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:28.238067 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:28.238370 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:28.238446 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:28.238502 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:28.238611 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 02:17:28.238661 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":135,"threads_started":1}
I20260806 02:17:28.246160 30454 raft_consensus.cc:1261] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Refusing update from remote peer 7fc5fc08bce045e7a8ec76d0c697021f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:28.246160 30251 raft_consensus.cc:1261] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Refusing update from remote peer 7fc5fc08bce045e7a8ec76d0c697021f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:28.246625 30669 consensus_queue.cc:1035] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:28.246799 30666 consensus_queue.cc:1035] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:28.279441 29798 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:28.279599 29798 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:28.281766 29798 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714: Sending DeleteTablet for 3 replicas of tablet adcff6c949384128a5b0a393d3a2c36f
I20260806 02:17:28.282369 29979 tablet_service.cc:1514] Processing DeleteTablet for tablet adcff6c949384128a5b0a393d3a2c36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:28 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:57790
I20260806 02:17:28.282506 30400 tablet_service.cc:1514] Processing DeleteTablet for tablet adcff6c949384128a5b0a393d3a2c36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:28 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:47646
I20260806 02:17:28.282721 30679 tablet_replica.cc:330] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f: stopping tablet replica
I20260806 02:17:28.282720 30221 tablet_service.cc:1514] Processing DeleteTablet for tablet adcff6c949384128a5b0a393d3a2c36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:28 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:59194
I20260806 02:17:28.282841 30678 tablet_replica.cc:330] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b: stopping tablet replica
I20260806 02:17:28.282857 30679 raft_consensus.cc:2229] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:17:28.282895 30680 tablet_replica.cc:330] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e: stopping tablet replica
I20260806 02:17:28.282972 30678 raft_consensus.cc:2229] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:28.282992 30680 raft_consensus.cc:2229] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:28.283062 30679 raft_consensus.cc:2258] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:28.283087 30678 raft_consensus.cc:2258] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:28.283094 30680 raft_consensus.cc:2258] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:28.283550 29798 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 02:17:28.283891 30678 ts_tablet_manager.cc:1905] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:28.283888 30680 ts_tablet_manager.cc:1905] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 02:17:28.284117 29798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:28.286293 30678 ts_tablet_manager.cc:1918] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:28.286391 30678 log.cc:1196] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/adcff6c949384128a5b0a393d3a2c36f
I20260806 02:17:28.286697 30678 ts_tablet_manager.cc:1939] T adcff6c949384128a5b0a393d3a2c36f P 0da7131c50cb42d3a3464756e206110b: Deleting consensus metadata
I20260806 02:17:28.286685 30680 ts_tablet_manager.cc:1918] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:28.286763 30680 log.cc:1196] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/adcff6c949384128a5b0a393d3a2c36f
I20260806 02:17:28.287009 30680 ts_tablet_manager.cc:1939] T adcff6c949384128a5b0a393d3a2c36f P abd5e8ec31d64322ad8e349cdc3af42e: Deleting consensus metadata
I20260806 02:17:28.287487 29772 catalog_manager.cc:4841] TS 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883): tablet adcff6c949384128a5b0a393d3a2c36f (table test-table [id=c18c920c123b4d2d8572fa056e71eed1]) successfully deleted
I20260806 02:17:28.287703 29770 catalog_manager.cc:4841] TS abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543): tablet adcff6c949384128a5b0a393d3a2c36f (table test-table [id=c18c920c123b4d2d8572fa056e71eed1]) successfully deleted
I20260806 02:17:28.288159 30679 ts_tablet_manager.cc:1905] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:28.289312 29979 tablet_service.cc:1467] Processing CreateTablet for tablet ea307bdd2c3a45a68caca84fa8f4f097 (DEFAULT_TABLE table=test-table [id=36555f7740df4678b2d95fd78ffc0b01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:28.289428 30221 tablet_service.cc:1467] Processing CreateTablet for tablet ea307bdd2c3a45a68caca84fa8f4f097 (DEFAULT_TABLE table=test-table [id=36555f7740df4678b2d95fd78ffc0b01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:28.289705 29979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea307bdd2c3a45a68caca84fa8f4f097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:28.289742 30221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea307bdd2c3a45a68caca84fa8f4f097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:28.290887 30679 ts_tablet_manager.cc:1918] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:28.290977 30679 log.cc:1196] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-0/wal/wals/adcff6c949384128a5b0a393d3a2c36f
I20260806 02:17:28.291253 30679 ts_tablet_manager.cc:1939] T adcff6c949384128a5b0a393d3a2c36f P 7fc5fc08bce045e7a8ec76d0c697021f: Deleting consensus metadata
I20260806 02:17:28.291831 30696 tablet_bootstrap.cc:492] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f: Bootstrap starting.
I20260806 02:17:28.292009 29770 catalog_manager.cc:4841] TS 7fc5fc08bce045e7a8ec76d0c697021f (127.26.189.129:38051): tablet adcff6c949384128a5b0a393d3a2c36f (table test-table [id=c18c920c123b4d2d8572fa056e71eed1]) successfully deleted
I20260806 02:17:28.292152 30400 tablet_service.cc:1467] Processing CreateTablet for tablet ea307bdd2c3a45a68caca84fa8f4f097 (DEFAULT_TABLE table=test-table [id=36555f7740df4678b2d95fd78ffc0b01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:28.292408 30400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea307bdd2c3a45a68caca84fa8f4f097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:28.292739 30696 tablet_bootstrap.cc:654] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:28.293291 30694 tablet_bootstrap.cc:492] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e: Bootstrap starting.
I20260806 02:17:28.294212 30694 tablet_bootstrap.cc:654] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:28.294750 30695 tablet_bootstrap.cc:492] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b: Bootstrap starting.
I20260806 02:17:28.295099 30696 tablet_bootstrap.cc:492] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f: No bootstrap required, opened a new log
I20260806 02:17:28.295161 30696 ts_tablet_manager.cc:1397] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 02:17:28.295449 30696 raft_consensus.cc:348] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.295508 30695 tablet_bootstrap.cc:654] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:28.295528 30696 raft_consensus.cc:374] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:28.295549 30696 raft_consensus.cc:729] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fc5fc08bce045e7a8ec76d0c697021f, State: Initialized, Role: FOLLOWER
I20260806 02:17:28.295645 30696 consensus_queue.cc:260] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.295939 30696 ts_tablet_manager.cc:1428] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 02:17:28.296720 30695 tablet_bootstrap.cc:492] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b: No bootstrap required, opened a new log
I20260806 02:17:28.296797 30694 tablet_bootstrap.cc:492] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e: No bootstrap required, opened a new log
I20260806 02:17:28.296831 30695 ts_tablet_manager.cc:1397] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 02:17:28.296895 30694 ts_tablet_manager.cc:1397] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260806 02:17:28.297273 30695 raft_consensus.cc:348] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.297281 30694 raft_consensus.cc:348] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.297401 30694 raft_consensus.cc:374] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:28.297403 30695 raft_consensus.cc:374] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:28.297432 30694 raft_consensus.cc:729] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd5e8ec31d64322ad8e349cdc3af42e, State: Initialized, Role: FOLLOWER
I20260806 02:17:28.297444 30695 raft_consensus.cc:729] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0da7131c50cb42d3a3464756e206110b, State: Initialized, Role: FOLLOWER
I20260806 02:17:28.297580 30694 consensus_queue.cc:260] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.297601 30695 consensus_queue.cc:260] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.297861 30694 ts_tablet_manager.cc:1428] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:28.297932 30695 ts_tablet_manager.cc:1428] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:28.303926 30627 raft_consensus.cc:482] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:28.304039 30627 raft_consensus.cc:504] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.304404 30627 leader_election.cc:288] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543), 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883)
I20260806 02:17:28.304703 30251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea307bdd2c3a45a68caca84fa8f4f097" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" is_pre_election: true
I20260806 02:17:28.304739 30454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea307bdd2c3a45a68caca84fa8f4f097" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0da7131c50cb42d3a3464756e206110b" is_pre_election: true
I20260806 02:17:28.304855 30454 raft_consensus.cc:2454] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 0.
I20260806 02:17:28.304857 30251 raft_consensus.cc:2454] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 0.
I20260806 02:17:28.305145 29936 leader_election.cc:302] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fc5fc08bce045e7a8ec76d0c697021f, abd5e8ec31d64322ad8e349cdc3af42e; no voters:
I20260806 02:17:28.305406 30627 raft_consensus.cc:2781] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:28.305480 30627 raft_consensus.cc:482] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:28.305554 30627 raft_consensus.cc:3037] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:28.306705 30627 raft_consensus.cc:504] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.307117 30627 leader_election.cc:288] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 election: Requested vote from peers abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543), 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883)
I20260806 02:17:28.307392 30251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea307bdd2c3a45a68caca84fa8f4f097" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd5e8ec31d64322ad8e349cdc3af42e"
I20260806 02:17:28.307466 30454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea307bdd2c3a45a68caca84fa8f4f097" candidate_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0da7131c50cb42d3a3464756e206110b"
I20260806 02:17:28.307508 30251 raft_consensus.cc:3037] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:28.307582 30454 raft_consensus.cc:3037] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:28.308642 30251 raft_consensus.cc:2454] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 1.
I20260806 02:17:28.308648 30454 raft_consensus.cc:2454] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fc5fc08bce045e7a8ec76d0c697021f in term 1.
I20260806 02:17:28.308892 29936 leader_election.cc:302] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fc5fc08bce045e7a8ec76d0c697021f, abd5e8ec31d64322ad8e349cdc3af42e; no voters:
I20260806 02:17:28.309130 30627 raft_consensus.cc:2781] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:28.309250 30627 raft_consensus.cc:686] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 LEADER]: Becoming Leader. State: Replica: 7fc5fc08bce045e7a8ec76d0c697021f, State: Running, Role: LEADER
I20260806 02:17:28.309388 30627 consensus_queue.cc:237] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } }
I20260806 02:17:28.311088 29797 catalog_manager.cc:5495] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fc5fc08bce045e7a8ec76d0c697021f (127.26.189.129). New cstate: current_term: 1 leader_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fc5fc08bce045e7a8ec76d0c697021f" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 } health_report { overall_health: UNKNOWN } } }
I20260806 02:17:28.330838 30453 raft_consensus.cc:1261] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Refusing update from remote peer 7fc5fc08bce045e7a8ec76d0c697021f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:28.331007 30251 raft_consensus.cc:1261] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Refusing update from remote peer 7fc5fc08bce045e7a8ec76d0c697021f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:28.331451 30627 consensus_queue.cc:1035] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd5e8ec31d64322ad8e349cdc3af42e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:28.332382 30627 consensus_queue.cc:1035] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0da7131c50cb42d3a3464756e206110b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 02:17:28.345467 30653 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 02:17:29.897401 29791 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:29.897599 29791 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:29.900108 29791 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9a548914f6eb49c2a365ad8dc6e4b714: Sending DeleteTablet for 3 replicas of tablet ea307bdd2c3a45a68caca84fa8f4f097
I20260806 02:17:29.900722 29979 tablet_service.cc:1514] Processing DeleteTablet for tablet ea307bdd2c3a45a68caca84fa8f4f097 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:29 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:57790
I20260806 02:17:29.900779 30221 tablet_service.cc:1514] Processing DeleteTablet for tablet ea307bdd2c3a45a68caca84fa8f4f097 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:29 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:59194
I20260806 02:17:29.900815 30400 tablet_service.cc:1514] Processing DeleteTablet for tablet ea307bdd2c3a45a68caca84fa8f4f097 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:29 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:47646
I20260806 02:17:29.901163 30775 tablet_replica.cc:330] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e: stopping tablet replica
I20260806 02:17:29.901187 30774 tablet_replica.cc:330] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f: stopping tablet replica
I20260806 02:17:29.901306 30775 raft_consensus.cc:2229] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:29.901361 30774 raft_consensus.cc:2229] T ea307bdd2c3a45a68caca84fa8f4f097 P 7fc5fc08bce045e7a8ec76d0c697021f [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:17:29.901436 30775 raft_consensus.cc:2258] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:29.901437 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 29910
I20260806 02:17:29.910481 30776 tablet_replica.cc:330] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b: stopping tablet replica
I20260806 02:17:29.910667 30776 raft_consensus.cc:2229] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:29.910820 30776 raft_consensus.cc:2258] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:29.911113 30775 ts_tablet_manager.cc:1905] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:29.911527 30776 ts_tablet_manager.cc:1905] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:29.914173 30776 ts_tablet_manager.cc:1918] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 02:17:29.914173 30775 ts_tablet_manager.cc:1918] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 02:17:29.914252 30776 log.cc:1196] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/ea307bdd2c3a45a68caca84fa8f4f097
I20260806 02:17:29.914252 30775 log.cc:1196] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/ea307bdd2c3a45a68caca84fa8f4f097
I20260806 02:17:29.914541 30776 ts_tablet_manager.cc:1939] T ea307bdd2c3a45a68caca84fa8f4f097 P 0da7131c50cb42d3a3464756e206110b: Deleting consensus metadata
I20260806 02:17:29.914620 30775 ts_tablet_manager.cc:1939] T ea307bdd2c3a45a68caca84fa8f4f097 P abd5e8ec31d64322ad8e349cdc3af42e: Deleting consensus metadata
I20260806 02:17:29.915388 29772 catalog_manager.cc:4841] TS 0da7131c50cb42d3a3464756e206110b (127.26.189.131:46883): tablet ea307bdd2c3a45a68caca84fa8f4f097 (table test-table [id=36555f7740df4678b2d95fd78ffc0b01]) successfully deleted
I20260806 02:17:29.915388 29770 catalog_manager.cc:4841] TS abd5e8ec31d64322ad8e349cdc3af42e (127.26.189.130:36543): tablet ea307bdd2c3a45a68caca84fa8f4f097 (table test-table [id=36555f7740df4678b2d95fd78ffc0b01]) successfully deleted
I20260806 02:17:29.918156 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 30119
W20260806 02:17:29.918179 29770 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:38051 (error 108)
I20260806 02:17:29.925879 30778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:29.924971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38051 (local address 127.0.0.1:33008)
0806 02:17:29.925608 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:29.925706 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:38051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":363,"threads_started":1}
W20260806 02:17:29.927805 29770 catalog_manager.cc:4584] TS 7fc5fc08bce045e7a8ec76d0c697021f (127.26.189.129:38051): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ea307bdd2c3a45a68caca84fa8f4f097: Network error: Client connection negotiation failed: client connection to 127.26.189.129:38051: connect: Connection refused (error 111)
I20260806 02:17:29.938066 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 30329
I20260806 02:17:29.954553 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 29743
2026-08-06T02:17:29Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6473 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:30 dist-test-slave-gkw7 krb5kdc[30781](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:30 dist-test-slave-gkw7 krb5kdc[30781](info): set up 2 sockets
Aug 06 02:17:30 dist-test-slave-gkw7 krb5kdc[30781](info): commencing operation
krb5kdc: starting...
W20260806 02:17:31.187198 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:31 dist-test-slave-gkw7 krb5kdc[30781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:17:31.328437 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:42231
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:42231
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:31.447222 30800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:31.447535 30800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:31.447582 30800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:31.451659 30800 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:31.451725 30800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:31.451748 30800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:31.451768 30800 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:31.451787 30800 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:31.457082 30800 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:42231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:42231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:31.458251 30800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:31.459264 30800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 02:17:31.468693 30800 server_base.cc:1034] running on GCE node
W20260806 02:17:31.468755 30810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:31.468886 30807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:31.468729 30812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:31.469521 30800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:31.470708 30800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:31.471907 30800 hybrid_clock.cc:648] HybridClock initialized: now 1785982651471877 us; error 42 us; skew 500 ppm
Aug 06 02:17:31 dist-test-slave-gkw7 krb5kdc[30781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982651, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:31.474874 30800 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:17:31.475891 30800 webserver.cc:460] Webserver started at http://127.26.189.190:44763/ using document root <none> and password file <none>
I20260806 02:17:31.476476 30800 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:31.476569 30800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:31.476816 30800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:31.479043 30800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "486774e5c48a46b7b01aa59b5c31e5c7"
format_stamp: "Formatted at 2026-08-06 02:17:31 on dist-test-slave-gkw7"
server_key: "df350cba191dc2cf9bd8d496419522b6"
server_key_iv: "18c70be77fea9a1ce3be56204143b126"
server_key_version: "encryptionkey@0"
I20260806 02:17:31.479643 30800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "486774e5c48a46b7b01aa59b5c31e5c7"
format_stamp: "Formatted at 2026-08-06 02:17:31 on dist-test-slave-gkw7"
server_key: "df350cba191dc2cf9bd8d496419522b6"
server_key_iv: "18c70be77fea9a1ce3be56204143b126"
server_key_version: "encryptionkey@0"
I20260806 02:17:31.483752 30800 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:31.486297 30822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:31.487702 30800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:31.487835 30800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "486774e5c48a46b7b01aa59b5c31e5c7"
format_stamp: "Formatted at 2026-08-06 02:17:31 on dist-test-slave-gkw7"
server_key: "df350cba191dc2cf9bd8d496419522b6"
server_key_iv: "18c70be77fea9a1ce3be56204143b126"
server_key_version: "encryptionkey@0"
I20260806 02:17:31.487942 30800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:31.500965 30800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:31.504148 30800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:31.504385 30800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:31.512180 30800 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:42231
I20260806 02:17:31.512198 30902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:42231 every 8 connection(s)
I20260806 02:17:31.513201 30800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:31.515852 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 30800
I20260806 02:17:31.515972 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:31.516290 27382 external_mini_cluster.cc:1428] Setting key f51f26903337e8e5b1f2febc6bbf089c
I20260806 02:17:31.516402 30903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:31.523185 30903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7: Bootstrap starting.
I20260806 02:17:31.525836 30903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7: Neither blocks nor log segments found. Creating new log.
Aug 06 02:17:31 dist-test-slave-gkw7 krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:31.526639 30903 log.cc:824] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:31.529197 30903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7: No bootstrap required, opened a new log
I20260806 02:17:31.531800 30907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:31.517923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38504 (local address 127.26.189.190:42231)
0806 02:17:31.518399 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:31.518420 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:31.518460 (+ 40us) server_negotiation.cc:407] Connection header received
0806 02:17:31.519363 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:31.519384 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:31.519730 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:31.520098 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:31.520974 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:31.522086 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:31.522992 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:31.523562 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:31.523751 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:31.526561 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:31.526566 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:31.526580 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:31.526610 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:31.528583 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:31.529129 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:31.529134 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:31.529139 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:31.529261 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:31.529708 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:31.529712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:31.529713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:31.530197 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:31.530357 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:31.530680 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 02:17:31.531031 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":147,"threads_started":1}
I20260806 02:17:31.533365 30903 raft_consensus.cc:348] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "486774e5c48a46b7b01aa59b5c31e5c7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42231 } }
I20260806 02:17:31.533663 30903 raft_consensus.cc:374] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:31.533735 30903 raft_consensus.cc:729] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 486774e5c48a46b7b01aa59b5c31e5c7, State: Initialized, Role: FOLLOWER
I20260806 02:17:31.534173 30903 consensus_queue.cc:260] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "486774e5c48a46b7b01aa59b5c31e5c7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42231 } }
I20260806 02:17:31.534343 30903 raft_consensus.cc:388] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:31.534421 30903 raft_consensus.cc:482] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:31.534548 30903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:31.535508 30903 raft_consensus.cc:504] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "486774e5c48a46b7b01aa59b5c31e5c7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42231 } }
I20260806 02:17:31.535852 30903 leader_election.cc:302] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 486774e5c48a46b7b01aa59b5c31e5c7; no voters:
I20260806 02:17:31.536202 30903 leader_election.cc:288] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:31.536379 30910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:31.536674 30910 raft_consensus.cc:686] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [term 1 LEADER]: Becoming Leader. State: Replica: 486774e5c48a46b7b01aa59b5c31e5c7, State: Running, Role: LEADER
I20260806 02:17:31.536993 30910 consensus_queue.cc:237] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "486774e5c48a46b7b01aa59b5c31e5c7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42231 } }
I20260806 02:17:31.537525 30903 sys_catalog.cc:564] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:31.538888 30911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "486774e5c48a46b7b01aa59b5c31e5c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "486774e5c48a46b7b01aa59b5c31e5c7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42231 } } }
I20260806 02:17:31.539022 30911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:31.539397 30912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 486774e5c48a46b7b01aa59b5c31e5c7. Latest consensus state: current_term: 1 leader_uuid: "486774e5c48a46b7b01aa59b5c31e5c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "486774e5c48a46b7b01aa59b5c31e5c7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42231 } } }
I20260806 02:17:31.539469 30921 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:31.539490 30912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:31.542428 30921 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:31.548516 30921 catalog_manager.cc:1347] Generated new cluster ID: 56fef6ebea2842848d09b872e95bf78a
I20260806 02:17:31.548640 30921 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:31.554037 30921 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:31.555022 30921 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:31.560384 30921 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 486774e5c48a46b7b01aa59b5c31e5c7: Generated new TSK 0
I20260806 02:17:31.561088 30921 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:17:31.600732 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42231
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:31.717824 30940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:31.718084 30940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:31.718127 30940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:31.722167 30940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:31.722241 30940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:31.722301 30940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:31.727630 30940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:31.728749 30940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:31.729866 30940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:31.740020 30951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:31.740056 30948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:31.740022 30947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:31.740509 30940 server_base.cc:1034] running on GCE node
I20260806 02:17:31.740939 30940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:31.741742 30940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:31.742962 30940 hybrid_clock.cc:648] HybridClock initialized: now 1785982651742941 us; error 32 us; skew 500 ppm
Aug 06 02:17:31 dist-test-slave-gkw7 krb5kdc[30781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982651, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:31.746166 30940 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:17:31.747108 30940 webserver.cc:460] Webserver started at http://127.26.189.129:33187/ using document root <none> and password file <none>
I20260806 02:17:31.747753 30940 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:31.747862 30940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:31.748111 30940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:31.750345 30940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "495098e3ab9e4e3db4d6cc5facf7ada6"
format_stamp: "Formatted at 2026-08-06 02:17:31 on dist-test-slave-gkw7"
server_key: "3453c62d2ded328d763b971bf859134d"
server_key_iv: "d9ec7d1139eb130486cf2afc05e3d420"
server_key_version: "encryptionkey@0"
I20260806 02:17:31.750941 30940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "495098e3ab9e4e3db4d6cc5facf7ada6"
format_stamp: "Formatted at 2026-08-06 02:17:31 on dist-test-slave-gkw7"
server_key: "3453c62d2ded328d763b971bf859134d"
server_key_iv: "d9ec7d1139eb130486cf2afc05e3d420"
server_key_version: "encryptionkey@0"
I20260806 02:17:31.754803 30940 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:31.757653 30961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:31.758939 30940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:31.759084 30940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "495098e3ab9e4e3db4d6cc5facf7ada6"
format_stamp: "Formatted at 2026-08-06 02:17:31 on dist-test-slave-gkw7"
server_key: "3453c62d2ded328d763b971bf859134d"
server_key_iv: "d9ec7d1139eb130486cf2afc05e3d420"
server_key_version: "encryptionkey@0"
I20260806 02:17:31.759212 30940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:31.772176 30940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:31.775076 30940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:31.775308 30940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:31.775902 30940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:31.776734 30940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:31.776806 30940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:31.776877 30940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:31.776932 30940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:31.786150 30940 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:36083
I20260806 02:17:31.786167 31137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:36083 every 8 connection(s)
I20260806 02:17:31.787223 30940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:31.788419 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 30940
I20260806 02:17:31.788544 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:17:31.788859 27382 external_mini_cluster.cc:1428] Setting key 1e79ec0707c718a75c11bd31d2733967
Aug 06 02:17:31 dist-test-slave-gkw7 krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982651, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:17:31.804180 30907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:31.789324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:48785 (local address 127.26.189.190:42231)
0806 02:17:31.789464 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:31.789468 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:31.790407 (+ 939us) server_negotiation.cc:407] Connection header received
0806 02:17:31.791778 (+ 1371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:31.791784 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:31.791849 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:31.791947 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:31.793496 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:31.794375 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:31.796289 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:31.796532 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:31.796636 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:31.799729 (+ 3093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:31.799732 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:31.799734 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:31.799758 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:31.801324 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:31.801947 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:31.801950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:31.801951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:31.802037 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:31.802518 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:31.802521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:31.802522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:31.802730 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:31.802816 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:31.803773 (+ 957us) server_negotiation.cc:299] Negotiation successful
0806 02:17:31.803926 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 02:17:31.805025 31142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:31.789786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:42231 (local address 127.26.189.129:48785)
0806 02:17:31.790261 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:31.790316 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:31.791549 (+ 1233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:31.792103 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:31.792110 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:31.792546 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:31.793308 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:31.793329 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:31.794546 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:31.794552 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:31.796135 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:31.796148 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:31.796716 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:31.796722 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:31.796984 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:31.797767 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:31.797794 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:31.799542 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:31.801443 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:31.801448 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:31.801462 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:31.801825 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:31.802189 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:31.802192 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:31.802193 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:31.802377 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:31.802910 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:31.802916 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:31.803404 (+ 488us) client_negotiation.cc:769] Sending connection context
0806 02:17:31.803674 (+ 270us) client_negotiation.cc:240] Negotiation successful
0806 02:17:31.803989 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":127,"threads_started":1}
I20260806 02:17:31.806514 31139 heartbeater.cc:347] Connected to a master server at 127.26.189.190:42231
I20260806 02:17:31.806789 31139 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:31.807320 31139 heartbeater.cc:511] Master 127.26.189.190:42231 requested a full tablet report, sending...
I20260806 02:17:31.809298 30844 ts_manager.cc:194] Registered new tserver with Master: 495098e3ab9e4e3db4d6cc5facf7ada6 (127.26.189.129:36083)
I20260806 02:17:31.811313 30844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:48785
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:17:31.822742 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42231
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:31.952821 31147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:31.953248 31147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:31.953341 31147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:31.962175 31147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:31.962275 31147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:31.962407 31147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:31.970968 31147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:31.972077 31147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:31.973104 31147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:31.984130 31153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:31.984130 31154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:31.984274 31157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:31.984503 31147 server_base.cc:1034] running on GCE node
I20260806 02:17:31.985016 31147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:31.985972 31147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:31.987182 31147 hybrid_clock.cc:648] HybridClock initialized: now 1785982651987163 us; error 36 us; skew 500 ppm
Aug 06 02:17:31 dist-test-slave-gkw7 krb5kdc[30781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982651, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:31.990588 31147 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:17:31.991657 31147 webserver.cc:460] Webserver started at http://127.26.189.130:44307/ using document root <none> and password file <none>
I20260806 02:17:31.992300 31147 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:31.992399 31147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:31.992652 31147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:31.994993 31147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "44b7b528906b40fc9cbcdb0551a6f9f6"
format_stamp: "Formatted at 2026-08-06 02:17:31 on dist-test-slave-gkw7"
server_key: "17f0e7911026c4592b4d6bcf0557e921"
server_key_iv: "8a7fd6b84a68c7a590c68c20d4e53312"
server_key_version: "encryptionkey@0"
I20260806 02:17:31.995611 31147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "44b7b528906b40fc9cbcdb0551a6f9f6"
format_stamp: "Formatted at 2026-08-06 02:17:31 on dist-test-slave-gkw7"
server_key: "17f0e7911026c4592b4d6bcf0557e921"
server_key_iv: "8a7fd6b84a68c7a590c68c20d4e53312"
server_key_version: "encryptionkey@0"
I20260806 02:17:31.999750 31147 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:32.002647 31166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:32.004060 31147 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:32.004243 31147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "44b7b528906b40fc9cbcdb0551a6f9f6"
format_stamp: "Formatted at 2026-08-06 02:17:31 on dist-test-slave-gkw7"
server_key: "17f0e7911026c4592b4d6bcf0557e921"
server_key_iv: "8a7fd6b84a68c7a590c68c20d4e53312"
server_key_version: "encryptionkey@0"
I20260806 02:17:32.004369 31147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:32.024322 31147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:32.027753 31147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:32.027997 31147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:32.028673 31147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:32.029657 31147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:32.029728 31147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:32.029805 31147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:32.029848 31147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:32.040439 31147 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:44735
I20260806 02:17:32.040457 31337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:44735 every 8 connection(s)
I20260806 02:17:32.041474 31147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:32.051194 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 31147
I20260806 02:17:32.051299 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:17:32.051584 27382 external_mini_cluster.cc:1428] Setting key 3ddacdbb3a0cee73016741e52f7dc30b
Aug 06 02:17:32 dist-test-slave-gkw7 krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982651, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:32.056860 30907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:32.043520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:51455 (local address 127.26.189.190:42231)
0806 02:17:32.043670 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:32.043674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:32.044492 (+ 818us) server_negotiation.cc:407] Connection header received
0806 02:17:32.045864 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:32.045867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:32.045930 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:32.046036 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:32.047254 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:32.047814 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:32.049014 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:32.049260 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:32.049376 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:32.052375 (+ 2999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:32.052378 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:32.052384 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:32.052424 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:32.054089 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:32.054789 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:32.054792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:32.054793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:32.054880 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:32.055364 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:32.055369 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:32.055371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:32.055683 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:32.055820 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:32.056463 (+ 643us) server_negotiation.cc:299] Negotiation successful
0806 02:17:32.056645 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 02:17:32.057942 31342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:32.043866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:42231 (local address 127.26.189.130:51455)
0806 02:17:32.044336 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:32.044381 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:32.045641 (+ 1260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:32.046216 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:32.046223 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:32.046598 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:32.047098 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:32.047111 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:32.047957 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:32.047961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:32.048877 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:32.048887 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:32.049440 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:32.049444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:32.049696 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:32.050374 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:32.050392 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:32.052206 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:32.054227 (+ 2021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:32.054237 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:32.054259 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:32.054667 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:32.054982 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:32.054988 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:32.054993 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:32.055219 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:32.055843 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:32.055849 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:32.056176 (+ 327us) client_negotiation.cc:769] Sending connection context
0806 02:17:32.056371 (+ 195us) client_negotiation.cc:240] Negotiation successful
0806 02:17:32.056672 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":117,"threads_started":1}
I20260806 02:17:32.059356 31340 heartbeater.cc:347] Connected to a master server at 127.26.189.190:42231
I20260806 02:17:32.059638 31340 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:32.060302 31340 heartbeater.cc:511] Master 127.26.189.190:42231 requested a full tablet report, sending...
I20260806 02:17:32.061504 30844 ts_manager.cc:194] Registered new tserver with Master: 44b7b528906b40fc9cbcdb0551a6f9f6 (127.26.189.130:44735)
I20260806 02:17:32.062247 30844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:51455
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:17:32.085937 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42231
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:32.202664 31345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:32.202931 31345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:32.202975 31345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:32.206969 31345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:32.207037 31345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:32.207096 31345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:32.212491 31345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:32.213621 31345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:32.214658 31345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:32.225081 31350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:32.225051 31354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:32.225564 31345 server_base.cc:1034] running on GCE node
W20260806 02:17:32.225603 31351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:32.226130 31345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:32.226861 31345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:32.228104 31345 hybrid_clock.cc:648] HybridClock initialized: now 1785982652228053 us; error 39 us; skew 500 ppm
Aug 06 02:17:32 dist-test-slave-gkw7 krb5kdc[30781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982652, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:32.231791 31345 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:17:32.232712 31345 webserver.cc:460] Webserver started at http://127.26.189.131:40987/ using document root <none> and password file <none>
I20260806 02:17:32.233330 31345 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:32.233428 31345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:32.233726 31345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:32.235816 31345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "2ff2a1a00b5c44dbbbacf9475e4a6351"
format_stamp: "Formatted at 2026-08-06 02:17:32 on dist-test-slave-gkw7"
server_key: "f1006a0b611e4b89d80ee74cc0be202a"
server_key_iv: "051375246b1c18773e573677b9de6238"
server_key_version: "encryptionkey@0"
I20260806 02:17:32.236413 31345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "2ff2a1a00b5c44dbbbacf9475e4a6351"
format_stamp: "Formatted at 2026-08-06 02:17:32 on dist-test-slave-gkw7"
server_key: "f1006a0b611e4b89d80ee74cc0be202a"
server_key_iv: "051375246b1c18773e573677b9de6238"
server_key_version: "encryptionkey@0"
I20260806 02:17:32.240619 31345 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:17:32.243398 31364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:32.244649 31345 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 02:17:32.244802 31345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "2ff2a1a00b5c44dbbbacf9475e4a6351"
format_stamp: "Formatted at 2026-08-06 02:17:32 on dist-test-slave-gkw7"
server_key: "f1006a0b611e4b89d80ee74cc0be202a"
server_key_iv: "051375246b1c18773e573677b9de6238"
server_key_version: "encryptionkey@0"
I20260806 02:17:32.244922 31345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:32.263568 31345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:32.267205 31345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:32.267423 31345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:32.268059 31345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:32.268937 31345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:32.269013 31345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:32.269083 31345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:32.269135 31345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:32.278846 31345 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:35099
I20260806 02:17:32.278873 31522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:35099 every 8 connection(s)
I20260806 02:17:32.279789 31345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:32.284087 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 31345
I20260806 02:17:32.284235 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:17:32.284623 27382 external_mini_cluster.cc:1428] Setting key db2a40214b3461a3f224cd66ea940a00
Aug 06 02:17:32 dist-test-slave-gkw7 krb5kdc[30781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982652, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:32.295167 30907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:32.281684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:59821 (local address 127.26.189.190:42231)
0806 02:17:32.281875 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:32.281879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:32.282808 (+ 929us) server_negotiation.cc:407] Connection header received
0806 02:17:32.284448 (+ 1640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:32.284452 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:32.284503 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:32.284585 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:32.286138 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:32.286711 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:32.288014 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:32.288410 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:32.288535 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:32.291405 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:32.291409 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:32.291412 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:32.291448 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:32.292974 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:32.293561 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:32.293565 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:32.293567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:32.293668 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:32.294041 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:32.294044 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:32.294046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:32.294245 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:32.294357 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:32.294863 (+ 506us) server_negotiation.cc:299] Negotiation successful
0806 02:17:32.294991 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 02:17:32.296110 31528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:32.282113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:42231 (local address 127.26.189.131:59821)
0806 02:17:32.282634 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:32.282681 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:32.284153 (+ 1472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:32.284778 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:32.284789 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:32.285228 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:32.285940 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:32.285966 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:32.286874 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:32.286884 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:32.287868 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:32.287879 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:32.288589 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:32.288594 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:32.288830 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:32.289464 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:32.289482 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:32.291225 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:32.293102 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:32.293118 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:32.293133 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:32.293403 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:32.293767 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:32.293771 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:32.293773 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:32.293929 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:32.294357 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:32.294365 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:32.294615 (+ 250us) client_negotiation.cc:769] Sending connection context
0806 02:17:32.294805 (+ 190us) client_negotiation.cc:240] Negotiation successful
0806 02:17:32.295204 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":120,"threads_started":1}
I20260806 02:17:32.297343 31524 heartbeater.cc:347] Connected to a master server at 127.26.189.190:42231
I20260806 02:17:32.297644 31524 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:32.298166 31524 heartbeater.cc:511] Master 127.26.189.190:42231 requested a full tablet report, sending...
I20260806 02:17:32.299171 30844 ts_manager.cc:194] Registered new tserver with Master: 2ff2a1a00b5c44dbbbacf9475e4a6351 (127.26.189.131:35099)
I20260806 02:17:32.299753 30844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:59821
I20260806 02:17:32.310508 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 02:17:32.326192 30907 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:17:32.324541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38510 (local address 127.26.189.190:42231)
0806 02:17:32.324724 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:32.324729 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:32.324897 (+ 168us) server_negotiation.cc:407] Connection header received
0806 02:17:32.325010 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:32.325012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:32.325094 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:32.325178 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:32.326010 (+ 832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38510: BlockingRecv error: recv got EOF from 127.0.0.1:38510 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 02:17:32.327135 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 30940
I20260806 02:17:32.341962 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 31147
I20260806 02:17:32.361177 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 31345
I20260806 02:17:32.372102 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 30800
2026-08-06T02:17:32Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2417 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:32 dist-test-slave-gkw7 krb5kdc[31542](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:32 dist-test-slave-gkw7 krb5kdc[31542](info): set up 2 sockets
Aug 06 02:17:32 dist-test-slave-gkw7 krb5kdc[31542](info): commencing operation
krb5kdc: starting...
W20260806 02:17:33.653848 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:33 dist-test-slave-gkw7 krb5kdc[31542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:17:33.783025 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:45035
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:42341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:45035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:33.894520 31562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:33.894836 31562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:33.894922 31562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:33.898942 31562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:33.899036 31562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:33.899073 31562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:33.899111 31562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:33.899147 31562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:33.904498 31562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:42341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:45035
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:45035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:33.905680 31562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:33.906731 31562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:33.915515 31569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:33.915522 31578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:33.915530 31572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:33.915712 31562 server_base.cc:1034] running on GCE node
I20260806 02:17:33.916445 31562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:33.917703 31562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:33.918895 31562 hybrid_clock.cc:648] HybridClock initialized: now 1785982653918875 us; error 33 us; skew 500 ppm
Aug 06 02:17:33 dist-test-slave-gkw7 krb5kdc[31542](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982653, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:33.926414 31562 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:17:33.927440 31562 webserver.cc:460] Webserver started at http://127.26.189.190:38393/ using document root <none> and password file <none>
I20260806 02:17:33.927995 31562 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:33.928058 31562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:33.928242 31562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:33.930428 31562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "eba4d22082ff48a5b8828f142f904ee8"
format_stamp: "Formatted at 2026-08-06 02:17:33 on dist-test-slave-gkw7"
server_key: "f5be1e580b2b00afb061f2b7b5145fdd"
server_key_iv: "694c12b4b62273b343d2b7dd59ba5038"
server_key_version: "encryptionkey@0"
I20260806 02:17:33.930959 31562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "eba4d22082ff48a5b8828f142f904ee8"
format_stamp: "Formatted at 2026-08-06 02:17:33 on dist-test-slave-gkw7"
server_key: "f5be1e580b2b00afb061f2b7b5145fdd"
server_key_iv: "694c12b4b62273b343d2b7dd59ba5038"
server_key_version: "encryptionkey@0"
I20260806 02:17:33.934891 31562 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:33.937443 31589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:33.938947 31562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:33.939116 31562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "eba4d22082ff48a5b8828f142f904ee8"
format_stamp: "Formatted at 2026-08-06 02:17:33 on dist-test-slave-gkw7"
server_key: "f5be1e580b2b00afb061f2b7b5145fdd"
server_key_iv: "694c12b4b62273b343d2b7dd59ba5038"
server_key_version: "encryptionkey@0"
I20260806 02:17:33.939277 31562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:33.974081 31562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:33.977464 31562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:33.977716 31562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:33.985455 31562 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:45035
I20260806 02:17:33.985483 31660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:45035 every 8 connection(s)
I20260806 02:17:33.986486 31562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:33.989349 31662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:33.989821 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 31562
I20260806 02:17:33.989944 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:33.990219 27382 external_mini_cluster.cc:1428] Setting key df94347221012a859a4bd89d9f3e75f7
I20260806 02:17:33.996620 31662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8: Bootstrap starting.
I20260806 02:17:33.999176 31662 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8: Neither blocks nor log segments found. Creating new log.
Aug 06 02:17:33 dist-test-slave-gkw7 krb5kdc[31542](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:34.000178 31662 log.cc:824] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:34.002681 31662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8: No bootstrap required, opened a new log
I20260806 02:17:34.006098 31665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:33.991627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39958 (local address 127.26.189.190:45035)
0806 02:17:33.992069 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:33.992084 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:33.992121 (+ 37us) server_negotiation.cc:407] Connection header received
0806 02:17:33.992824 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:33.992848 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:33.993193 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:33.993579 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:33.994591 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:33.995621 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:33.996528 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:33.997094 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:33.997295 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:34.000261 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:34.000288 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:34.000308 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:34.000370 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:34.002557 (+ 2187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:34.003086 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:34.003092 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:34.003098 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:34.003254 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:34.003623 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:34.003626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:34.003628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:34.004136 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:34.004353 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:34.004647 (+ 294us) server_negotiation.cc:299] Negotiation successful
0806 02:17:34.004985 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":125,"threads_started":1}
I20260806 02:17:34.007494 31662 raft_consensus.cc:348] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba4d22082ff48a5b8828f142f904ee8" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45035 } }
I20260806 02:17:34.007725 31662 raft_consensus.cc:374] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:34.007786 31662 raft_consensus.cc:729] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eba4d22082ff48a5b8828f142f904ee8, State: Initialized, Role: FOLLOWER
I20260806 02:17:34.008277 31662 consensus_queue.cc:260] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba4d22082ff48a5b8828f142f904ee8" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45035 } }
I20260806 02:17:34.008459 31662 raft_consensus.cc:388] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:34.008527 31662 raft_consensus.cc:482] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:34.008625 31662 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:34.009199 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:17:34.009840 31662 raft_consensus.cc:504] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba4d22082ff48a5b8828f142f904ee8" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45035 } }
I20260806 02:17:34.010223 31662 leader_election.cc:302] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eba4d22082ff48a5b8828f142f904ee8; no voters:
I20260806 02:17:34.010593 31662 leader_election.cc:288] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:34.010748 31668 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:34.011037 31668 raft_consensus.cc:686] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [term 1 LEADER]: Becoming Leader. State: Replica: eba4d22082ff48a5b8828f142f904ee8, State: Running, Role: LEADER
I20260806 02:17:34.011413 31668 consensus_queue.cc:237] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba4d22082ff48a5b8828f142f904ee8" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45035 } }
I20260806 02:17:34.012034 31662 sys_catalog.cc:564] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:34.013303 31671 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eba4d22082ff48a5b8828f142f904ee8. Latest consensus state: current_term: 1 leader_uuid: "eba4d22082ff48a5b8828f142f904ee8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba4d22082ff48a5b8828f142f904ee8" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45035 } } }
I20260806 02:17:34.013303 31669 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eba4d22082ff48a5b8828f142f904ee8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba4d22082ff48a5b8828f142f904ee8" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45035 } } }
I20260806 02:17:34.013461 31671 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:34.013461 31669 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:34.013906 31683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:34.017179 31683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:34.023931 31683 catalog_manager.cc:1347] Generated new cluster ID: 33fdc438457a4b60a172be7363f33e27
I20260806 02:17:34.024000 31683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:34.031560 31665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:34.025609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39964 (local address 127.26.189.190:45035)
0806 02:17:34.025743 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:34.025750 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:34.026160 (+ 410us) server_negotiation.cc:407] Connection header received
0806 02:17:34.026347 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:34.026350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:34.026407 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:34.026501 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:34.027068 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:34.027676 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:34.028627 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:34.028906 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:34.029026 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:34.030039 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:34.030043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:34.030046 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:34.030509 (+ 463us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:34.030556 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:34.030574 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:34.030700 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:34.031297 (+ 597us) server_negotiation.cc:299] Negotiation successful
0806 02:17:34.031369 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 02:17:34.031975 31683 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:34.033205 31683 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:34.038851 31683 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eba4d22082ff48a5b8828f142f904ee8: Generated new TSK 0
I20260806 02:17:34.039654 31683 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:17:34.050055 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 31562
2026-08-06T02:17:34Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1677 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:34 dist-test-slave-gkw7 krb5kdc[31709](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:34 dist-test-slave-gkw7 krb5kdc[31709](info): set up 2 sockets
Aug 06 02:17:34 dist-test-slave-gkw7 krb5kdc[31709](info): commencing operation
krb5kdc: starting...
W20260806 02:17:35.307904 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:35 dist-test-slave-gkw7 krb5kdc[31709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:17:35.440929 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:45587
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:45587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:35.559682 31730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:35.560009 31730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:35.560086 31730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:35.564193 31730 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:35.564286 31730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:35.564327 31730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:35.564385 31730 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:35.564424 31730 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:35.569780 31730 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:45587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:45587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31730
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:35.570892 31730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:35.571954 31730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:35.581144 31743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:35.581144 31747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:35.581138 31740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:35.581419 31730 server_base.cc:1034] running on GCE node
I20260806 02:17:35.582245 31730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:35.583370 31730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:35.584561 31730 hybrid_clock.cc:648] HybridClock initialized: now 1785982655584543 us; error 34 us; skew 500 ppm
Aug 06 02:17:35 dist-test-slave-gkw7 krb5kdc[31709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982655, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:35.588027 31730 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:17:35.588982 31730 webserver.cc:460] Webserver started at http://127.26.189.190:43043/ using document root <none> and password file <none>
I20260806 02:17:35.589603 31730 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:35.589672 31730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:35.589859 31730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:35.591924 31730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "e419ba15db914b638d82bbfab4963e7a"
format_stamp: "Formatted at 2026-08-06 02:17:35 on dist-test-slave-gkw7"
server_key: "517ac8628c71df760ec91fcddd2445da"
server_key_iv: "a971f93a86893a116844ab642d7f14e9"
server_key_version: "encryptionkey@0"
I20260806 02:17:35.592469 31730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "e419ba15db914b638d82bbfab4963e7a"
format_stamp: "Formatted at 2026-08-06 02:17:35 on dist-test-slave-gkw7"
server_key: "517ac8628c71df760ec91fcddd2445da"
server_key_iv: "a971f93a86893a116844ab642d7f14e9"
server_key_version: "encryptionkey@0"
I20260806 02:17:35.596351 31730 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:17:35.599026 31755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:35.600364 31730 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 02:17:35.600500 31730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "e419ba15db914b638d82bbfab4963e7a"
format_stamp: "Formatted at 2026-08-06 02:17:35 on dist-test-slave-gkw7"
server_key: "517ac8628c71df760ec91fcddd2445da"
server_key_iv: "a971f93a86893a116844ab642d7f14e9"
server_key_version: "encryptionkey@0"
I20260806 02:17:35.600611 31730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:35.617853 31730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:35.620750 31730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:35.620965 31730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:35.628463 31730 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:45587
I20260806 02:17:35.628875 31836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:45587 every 8 connection(s)
I20260806 02:17:35.629516 31730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:35.632355 31837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:35.637825 31837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a: Bootstrap starting.
I20260806 02:17:35.638360 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 31730
I20260806 02:17:35.638504 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:35.638803 27382 external_mini_cluster.cc:1428] Setting key 7b50e248a65bf55c24e335e7f70e6ff0
I20260806 02:17:35.640655 31837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:35.641417 31837 log.cc:824] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:35.643699 31837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a: No bootstrap required, opened a new log
I20260806 02:17:35.647737 31837 raft_consensus.cc:348] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e419ba15db914b638d82bbfab4963e7a" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45587 } }
Aug 06 02:17:35 dist-test-slave-gkw7 krb5kdc[31709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:35.648000 31837 raft_consensus.cc:374] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:35.648092 31837 raft_consensus.cc:729] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e419ba15db914b638d82bbfab4963e7a, State: Initialized, Role: FOLLOWER
I20260806 02:17:35.648607 31837 consensus_queue.cc:260] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e419ba15db914b638d82bbfab4963e7a" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45587 } }
I20260806 02:17:35.648772 31837 raft_consensus.cc:388] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:35.648873 31837 raft_consensus.cc:482] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:35.648968 31837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:35.649960 31837 raft_consensus.cc:504] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e419ba15db914b638d82bbfab4963e7a" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45587 } }
I20260806 02:17:35.650296 31837 leader_election.cc:302] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e419ba15db914b638d82bbfab4963e7a; no voters:
I20260806 02:17:35.650641 31837 leader_election.cc:288] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:35.650758 31844 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:35.650974 31844 raft_consensus.cc:686] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [term 1 LEADER]: Becoming Leader. State: Replica: e419ba15db914b638d82bbfab4963e7a, State: Running, Role: LEADER
I20260806 02:17:35.651340 31844 consensus_queue.cc:237] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e419ba15db914b638d82bbfab4963e7a" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45587 } }
I20260806 02:17:35.652088 31837 sys_catalog.cc:564] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:35.654065 31848 sys_catalog.cc:455] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e419ba15db914b638d82bbfab4963e7a. Latest consensus state: current_term: 1 leader_uuid: "e419ba15db914b638d82bbfab4963e7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e419ba15db914b638d82bbfab4963e7a" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45587 } } }
I20260806 02:17:35.654198 31848 sys_catalog.cc:458] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:35.654486 31840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:35.640152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48290 (local address 127.26.189.190:45587)
0806 02:17:35.640569 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:35.640585 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:35.640621 (+ 36us) server_negotiation.cc:407] Connection header received
0806 02:17:35.641315 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:35.641333 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:35.641751 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:35.642048 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:35.642843 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:35.644334 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:35.645179 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:35.645926 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:35.646102 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:35.648706 (+ 2604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:35.648711 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:35.648724 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:35.648782 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:35.650950 (+ 2168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:35.651472 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:35.651478 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:35.651483 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:35.651627 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:35.651965 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:35.651969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:35.651970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:35.652503 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:35.652689 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:35.653180 (+ 491us) server_negotiation.cc:299] Negotiation successful
0806 02:17:35.653480 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":139,"threads_started":1}
I20260806 02:17:35.654897 31867 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:35.654563 31846 sys_catalog.cc:455] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e419ba15db914b638d82bbfab4963e7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e419ba15db914b638d82bbfab4963e7a" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45587 } } }
I20260806 02:17:35.655094 31846 sys_catalog.cc:458] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:35.657511 31867 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:35.663085 31867 catalog_manager.cc:1347] Generated new cluster ID: e55d1e2bd1cd4bfb8330b01f23168bf6
I20260806 02:17:35.663156 31867 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:35.691921 31867 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:35.693315 31867 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:35.701354 31867 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e419ba15db914b638d82bbfab4963e7a: Generated new TSK 0
I20260806 02:17:35.702215 31867 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:17:35.733196 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:45587
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:35.851011 31875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:35.851308 31875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:35.851356 31875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:35.855818 31875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:35.855893 31875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:35.855954 31875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:35.861371 31875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:45587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:35.862524 31875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:35.863610 31875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:35.873466 31881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:35.873481 31884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:35.873646 31875 server_base.cc:1034] running on GCE node
W20260806 02:17:35.873693 31882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:35.874209 31875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:35.874853 31875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:35.876034 31875 hybrid_clock.cc:648] HybridClock initialized: now 1785982655876010 us; error 32 us; skew 500 ppm
Aug 06 02:17:35 dist-test-slave-gkw7 krb5kdc[31709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982655, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:35.878985 31875 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:17:35.879901 31875 webserver.cc:460] Webserver started at http://127.26.189.129:46777/ using document root <none> and password file <none>
I20260806 02:17:35.880478 31875 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:35.880569 31875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:35.880812 31875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:35.882967 31875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "042851e776654f00b3b8decef8c4ea62"
format_stamp: "Formatted at 2026-08-06 02:17:35 on dist-test-slave-gkw7"
server_key: "5d7d697b6b8909d63ddb90325e9efc1e"
server_key_iv: "cca62bc31cb8e2db0912d4143a2d113f"
server_key_version: "encryptionkey@0"
I20260806 02:17:35.883558 31875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "042851e776654f00b3b8decef8c4ea62"
format_stamp: "Formatted at 2026-08-06 02:17:35 on dist-test-slave-gkw7"
server_key: "5d7d697b6b8909d63ddb90325e9efc1e"
server_key_iv: "cca62bc31cb8e2db0912d4143a2d113f"
server_key_version: "encryptionkey@0"
I20260806 02:17:35.887379 31875 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 02:17:35.889880 31893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:35.891110 31875 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 02:17:35.891234 31875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "042851e776654f00b3b8decef8c4ea62"
format_stamp: "Formatted at 2026-08-06 02:17:35 on dist-test-slave-gkw7"
server_key: "5d7d697b6b8909d63ddb90325e9efc1e"
server_key_iv: "cca62bc31cb8e2db0912d4143a2d113f"
server_key_version: "encryptionkey@0"
I20260806 02:17:35.891340 31875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:35.904361 31875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:35.907691 31875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:35.907907 31875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:35.908537 31875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:35.909400 31875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:35.909449 31875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:35.909519 31875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:35.909610 31875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:35.918640 31875 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:46731
I20260806 02:17:35.918659 32060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:46731 every 8 connection(s)
I20260806 02:17:35.919581 31875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:35.920601 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 31875
I20260806 02:17:35.920740 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:17:35.921059 27382 external_mini_cluster.cc:1428] Setting key 7757435141a323fc17f1ba1874b4d634
Aug 06 02:17:35 dist-test-slave-gkw7 krb5kdc[31709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982655, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:17:35.936295 31840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:35.921718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:41089 (local address 127.26.189.190:45587)
0806 02:17:35.921878 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:35.921882 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:35.922924 (+ 1042us) server_negotiation.cc:407] Connection header received
0806 02:17:35.924301 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:35.924305 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:35.924360 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:35.924441 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:35.926130 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:35.926693 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:35.928592 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:35.928830 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:35.928925 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:35.932012 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:35.932015 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:35.932018 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:35.932082 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:35.933779 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:35.934353 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:35.934357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:35.934359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:35.934452 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:35.934844 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:35.934847 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:35.934849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:35.935055 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:35.935197 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:35.935807 (+ 610us) server_negotiation.cc:299] Negotiation successful
0806 02:17:35.935969 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 02:17:35.936843 32066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:35.922189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:45587 (local address 127.26.189.129:41089)
0806 02:17:35.922774 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:35.922827 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:35.924081 (+ 1254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:35.924618 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:35.924629 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:35.925179 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:35.925944 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:35.925969 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:35.926849 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:35.926856 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:35.928447 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:35.928463 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:35.929013 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:35.929020 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:35.929268 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:35.929996 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:35.930021 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:35.931818 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:35.933924 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:35.933930 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:35.933946 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:35.934231 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:35.934564 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:35.934568 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:35.934570 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:35.934726 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:35.935200 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:35.935210 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:35.935527 (+ 317us) client_negotiation.cc:769] Sending connection context
0806 02:17:35.935692 (+ 165us) client_negotiation.cc:240] Negotiation successful
0806 02:17:35.935964 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":162,"threads_started":1}
I20260806 02:17:35.938256 32062 heartbeater.cc:347] Connected to a master server at 127.26.189.190:45587
I20260806 02:17:35.938531 32062 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:35.939036 32062 heartbeater.cc:511] Master 127.26.189.190:45587 requested a full tablet report, sending...
I20260806 02:17:35.940810 31780 ts_manager.cc:194] Registered new tserver with Master: 042851e776654f00b3b8decef8c4ea62 (127.26.189.129:46731)
I20260806 02:17:35.942615 31780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:41089
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:17:35.953127 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:45587
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:36.066664 32070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:36.066927 32070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:36.066970 32070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:36.070945 32070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:36.071000 32070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:36.071058 32070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:36.076238 32070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:45587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:36.077217 32070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:36.078208 32070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:36.088205 32077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:36.088261 32070 server_base.cc:1034] running on GCE node
W20260806 02:17:36.088217 32078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:36.088218 32080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:36.088877 32070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:36.089588 32070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:36.090778 32070 hybrid_clock.cc:648] HybridClock initialized: now 1785982656090768 us; error 31 us; skew 500 ppm
Aug 06 02:17:36 dist-test-slave-gkw7 krb5kdc[31709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982656, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:36.093472 32070 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:17:36.094435 32070 webserver.cc:460] Webserver started at http://127.26.189.130:33245/ using document root <none> and password file <none>
I20260806 02:17:36.095013 32070 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:36.095108 32070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:36.095347 32070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:36.097440 32070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "3289aef1ee614eecb86243ca7f5d063d"
format_stamp: "Formatted at 2026-08-06 02:17:36 on dist-test-slave-gkw7"
server_key: "92b92d098f0a291d055356fbbe8fb3cb"
server_key_iv: "9d306fe1b6594a706d7af95f39a3d095"
server_key_version: "encryptionkey@0"
I20260806 02:17:36.098085 32070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "3289aef1ee614eecb86243ca7f5d063d"
format_stamp: "Formatted at 2026-08-06 02:17:36 on dist-test-slave-gkw7"
server_key: "92b92d098f0a291d055356fbbe8fb3cb"
server_key_iv: "9d306fe1b6594a706d7af95f39a3d095"
server_key_version: "encryptionkey@0"
I20260806 02:17:36.102039 32070 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 02:17:36.104497 32092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:36.105866 32070 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:17:36.106000 32070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "3289aef1ee614eecb86243ca7f5d063d"
format_stamp: "Formatted at 2026-08-06 02:17:36 on dist-test-slave-gkw7"
server_key: "92b92d098f0a291d055356fbbe8fb3cb"
server_key_iv: "9d306fe1b6594a706d7af95f39a3d095"
server_key_version: "encryptionkey@0"
I20260806 02:17:36.106114 32070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:36.135584 32070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:36.138638 32070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:36.138864 32070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:36.139492 32070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:36.140381 32070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:36.140455 32070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:36.140527 32070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:36.140578 32070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:36.149734 32070 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:35199
I20260806 02:17:36.149765 32244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:35199 every 8 connection(s)
I20260806 02:17:36.150667 32070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:36.160830 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 32070
Aug 06 02:17:36 dist-test-slave-gkw7 krb5kdc[31709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982656, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:36.160979 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:17:36.161312 27382 external_mini_cluster.cc:1428] Setting key b8930723a52003372f797cd194a599e1
I20260806 02:17:36.165939 31840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:36.152675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:48545 (local address 127.26.189.190:45587)
0806 02:17:36.152875 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:36.152881 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:36.153847 (+ 966us) server_negotiation.cc:407] Connection header received
0806 02:17:36.155497 (+ 1650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:36.155501 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:36.155558 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:36.155670 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:36.156891 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:36.157437 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:36.158631 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:36.158870 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:36.158988 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:36.161649 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:36.161652 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:36.161654 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:36.161677 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:36.163341 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:36.163966 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:36.163968 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:36.163969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:36.164043 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:36.164528 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:36.164531 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:36.164532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:36.164725 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:36.164813 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:36.165563 (+ 750us) server_negotiation.cc:299] Negotiation successful
0806 02:17:36.165723 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 02:17:36.166699 32249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:36.153103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:45587 (local address 127.26.189.130:48545)
0806 02:17:36.153668 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:36.153738 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:36.155272 (+ 1534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:36.155864 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:36.155871 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:36.156241 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:36.156728 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:36.156741 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:36.157593 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:36.157599 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:36.158494 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:36.158504 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:36.159034 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:36.159038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:36.159209 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:36.159828 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:36.159845 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:36.161463 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:36.163462 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:36.163469 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:36.163488 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:36.163855 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:36.164165 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:36.164171 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:36.164175 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:36.164379 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:36.164839 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:36.164849 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:36.165181 (+ 332us) client_negotiation.cc:769] Sending connection context
0806 02:17:36.165395 (+ 214us) client_negotiation.cc:240] Negotiation successful
0806 02:17:36.165726 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":104,"threads_started":1}
I20260806 02:17:36.167912 32246 heartbeater.cc:347] Connected to a master server at 127.26.189.190:45587
I20260806 02:17:36.168187 32246 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:36.168828 32246 heartbeater.cc:511] Master 127.26.189.190:45587 requested a full tablet report, sending...
I20260806 02:17:36.170135 31780 ts_manager.cc:194] Registered new tserver with Master: 3289aef1ee614eecb86243ca7f5d063d (127.26.189.130:35199)
I20260806 02:17:36.170794 31780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:48545
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:17:36.193085 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:45587
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:36.310108 32253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:36.310390 32253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:36.310432 32253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:36.314441 32253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:36.314493 32253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:36.314548 32253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:36.319547 32253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:45587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:36.320497 32253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:36.321450 32253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:36.331377 32263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:36.331399 32261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:36.331424 32260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:36.331589 32253 server_base.cc:1034] running on GCE node
I20260806 02:17:36.332257 32253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:36.332955 32253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:36.334117 32253 hybrid_clock.cc:648] HybridClock initialized: now 1785982656334089 us; error 39 us; skew 500 ppm
Aug 06 02:17:36 dist-test-slave-gkw7 krb5kdc[31709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982656, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:36.336925 32253 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:17:36.337883 32253 webserver.cc:460] Webserver started at http://127.26.189.131:36673/ using document root <none> and password file <none>
I20260806 02:17:36.338439 32253 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:36.338500 32253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:36.338744 32253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:36.340857 32253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "f086b543826a47f4b8c4776f644f2925"
format_stamp: "Formatted at 2026-08-06 02:17:36 on dist-test-slave-gkw7"
server_key: "a82233644f991a30bd2c8aeed6e7e398"
server_key_iv: "933085f23f1bf5f6467e561b9cc4780a"
server_key_version: "encryptionkey@0"
I20260806 02:17:36.341426 32253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "f086b543826a47f4b8c4776f644f2925"
format_stamp: "Formatted at 2026-08-06 02:17:36 on dist-test-slave-gkw7"
server_key: "a82233644f991a30bd2c8aeed6e7e398"
server_key_iv: "933085f23f1bf5f6467e561b9cc4780a"
server_key_version: "encryptionkey@0"
I20260806 02:17:36.345124 32253 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:36.347626 32274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:36.348867 32253 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 02:17:36.348990 32253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "f086b543826a47f4b8c4776f644f2925"
format_stamp: "Formatted at 2026-08-06 02:17:36 on dist-test-slave-gkw7"
server_key: "a82233644f991a30bd2c8aeed6e7e398"
server_key_iv: "933085f23f1bf5f6467e561b9cc4780a"
server_key_version: "encryptionkey@0"
I20260806 02:17:36.349097 32253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:36.363994 32253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:36.367275 32253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:36.367432 32253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:36.368090 32253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:36.368937 32253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:36.368985 32253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:36.369055 32253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:36.369095 32253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:36.378548 32253 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:34885
I20260806 02:17:36.378569 32427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:34885 every 8 connection(s)
I20260806 02:17:36.379446 32253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:36.380231 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 32253
I20260806 02:17:36.380362 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:17:36.380685 27382 external_mini_cluster.cc:1428] Setting key 8208194e65b3301a9706a0c4fccdc9b2
Aug 06 02:17:36 dist-test-slave-gkw7 krb5kdc[31709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982656, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:36.394259 31840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:36.381404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:49173 (local address 127.26.189.190:45587)
0806 02:17:36.381525 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:36.381531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:36.383143 (+ 1612us) server_negotiation.cc:407] Connection header received
0806 02:17:36.384529 (+ 1386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:36.384532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:36.384586 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:36.384677 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:36.385910 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:36.386455 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:36.387608 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:36.387839 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:36.387955 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:36.390573 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:36.390581 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:36.390583 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:36.390606 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:36.391960 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:36.392520 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:36.392523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:36.392524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:36.392600 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:36.392963 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:36.392967 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:36.392969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:36.393158 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:36.393270 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:36.393885 (+ 615us) server_negotiation.cc:299] Negotiation successful
0806 02:17:36.394058 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 02:17:36.395320 32436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:36.381927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:45587 (local address 127.26.189.131:49173)
0806 02:17:36.382993 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:36.383036 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:36.384317 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:36.384848 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:36.384855 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:36.385220 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:36.385764 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:36.385779 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:36.386584 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:36.386588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:36.387473 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:36.387482 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:36.387991 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:36.387995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:36.388177 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:36.388791 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:36.388825 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:36.390405 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:36.392092 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:36.392098 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:36.392113 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:36.392398 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:36.392709 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:36.392712 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:36.392714 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:36.392854 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:36.393270 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:36.393278 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:36.393569 (+ 291us) client_negotiation.cc:769] Sending connection context
0806 02:17:36.393786 (+ 217us) client_negotiation.cc:240] Negotiation successful
0806 02:17:36.394189 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":837,"thread_start_us":134,"threads_started":1}
I20260806 02:17:36.396454 32429 heartbeater.cc:347] Connected to a master server at 127.26.189.190:45587
I20260806 02:17:36.396694 32429 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:36.397172 32429 heartbeater.cc:511] Master 127.26.189.190:45587 requested a full tablet report, sending...
I20260806 02:17:36.398258 31780 ts_manager.cc:194] Registered new tserver with Master: f086b543826a47f4b8c4776f644f2925 (127.26.189.131:34885)
I20260806 02:17:36.398836 31780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:49173
I20260806 02:17:36.407039 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 02:17:36 dist-test-slave-gkw7 krb5kdc[31709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982656, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 02:17:36 dist-test-slave-gkw7 krb5kdc[31709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982656, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:36.435276 31840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:36.426749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52392 (local address 127.26.189.190:45587)
0806 02:17:36.426938 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:36.426943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:36.427068 (+ 125us) server_negotiation.cc:407] Connection header received
0806 02:17:36.427250 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:36.427253 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:36.427306 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:36.427399 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:36.428127 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:36.428689 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:36.429576 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:36.429810 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:36.429928 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:36.432250 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:36.432254 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:36.432256 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:36.432279 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:36.433504 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:36.433977 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:36.433981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:36.433983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:36.434067 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:36.434350 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:36.434353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:36.434355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:36.434578 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:36.434728 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:36.434967 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 02:17:36.435086 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
W20260806 02:17:36.435715 31780 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52392
I20260806 02:17:36.436707 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 31875
I20260806 02:17:36.460407 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 32070
I20260806 02:17:36.468822 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 32253
I20260806 02:17:36.476343 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 31730
2026-08-06T02:17:36Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2425 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:36 dist-test-slave-gkw7 krb5kdc[32449](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:36 dist-test-slave-gkw7 krb5kdc[32449](info): set up 2 sockets
Aug 06 02:17:36 dist-test-slave-gkw7 krb5kdc[32449](info): commencing operation
krb5kdc: starting...
W20260806 02:17:37.739125 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:37 dist-test-slave-gkw7 krb5kdc[32449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:17:37.869004 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39383
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:39383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:37.982558 32465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:37.982859 32465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:37.982903 32465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:37.987116 32465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:37.987183 32465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:37.987203 32465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:37.987221 32465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:37.987236 32465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:37.992738 32465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:39383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:37.993997 32465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:37.995123 32465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:38.004529 32475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:38.004473 32472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:38.004473 32478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:38.004657 32465 server_base.cc:1034] running on GCE node
I20260806 02:17:38.005630 32465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:38.006886 32465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:38.008090 32465 hybrid_clock.cc:648] HybridClock initialized: now 1785982658008051 us; error 50 us; skew 500 ppm
Aug 06 02:17:38 dist-test-slave-gkw7 krb5kdc[32449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:38.011209 32465 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:17:38.012215 32465 webserver.cc:460] Webserver started at http://127.26.189.190:44351/ using document root <none> and password file <none>
I20260806 02:17:38.012840 32465 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:38.012904 32465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:38.013160 32465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:38.015386 32465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "66de2e1e8879455ba92e59d7600a981f"
format_stamp: "Formatted at 2026-08-06 02:17:38 on dist-test-slave-gkw7"
server_key: "1b50f2482ddd950c6212a569424e5370"
server_key_iv: "3a77dd44e33e18424d1a83c3530263d2"
server_key_version: "encryptionkey@0"
I20260806 02:17:38.016001 32465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "66de2e1e8879455ba92e59d7600a981f"
format_stamp: "Formatted at 2026-08-06 02:17:38 on dist-test-slave-gkw7"
server_key: "1b50f2482ddd950c6212a569424e5370"
server_key_iv: "3a77dd44e33e18424d1a83c3530263d2"
server_key_version: "encryptionkey@0"
I20260806 02:17:38.019958 32465 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260806 02:17:38.022518 32491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:38.023898 32465 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:38.024032 32465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "66de2e1e8879455ba92e59d7600a981f"
format_stamp: "Formatted at 2026-08-06 02:17:38 on dist-test-slave-gkw7"
server_key: "1b50f2482ddd950c6212a569424e5370"
server_key_iv: "3a77dd44e33e18424d1a83c3530263d2"
server_key_version: "encryptionkey@0"
I20260806 02:17:38.024159 32465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:38.063508 32465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:38.067211 32465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:38.067457 32465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:38.075078 32465 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:39383
I20260806 02:17:38.075102 32568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:39383 every 8 connection(s)
I20260806 02:17:38.076087 32465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:38.076454 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 32465
I20260806 02:17:38.076586 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:38.076858 27382 external_mini_cluster.cc:1428] Setting key 317ad86207f7bf2648388f436864795a
I20260806 02:17:38.079445 32571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:38.085327 32571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f: Bootstrap starting.
Aug 06 02:17:38 dist-test-slave-gkw7 krb5kdc[32449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:38.088105 32571 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:38.088972 32571 log.cc:824] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:38.091293 32571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f: No bootstrap required, opened a new log
I20260806 02:17:38.091902 32577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:38.078369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56948 (local address 127.26.189.190:39383)
0806 02:17:38.078849 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:38.078865 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:38.078904 (+ 39us) server_negotiation.cc:407] Connection header received
0806 02:17:38.079639 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:38.079660 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:38.079996 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:38.080347 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:38.081225 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.082319 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.083202 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.083672 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.083845 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:38.086742 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:38.086747 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:38.086760 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:38.086788 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:38.088597 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:38.089134 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:38.089142 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:38.089148 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:38.089292 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:38.089659 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:38.089662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:38.089663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:38.090119 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:38.090283 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:38.090594 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 02:17:38.090901 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":159,"threads_started":1}
I20260806 02:17:38.094430 32571 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66de2e1e8879455ba92e59d7600a981f" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39383 } }
I20260806 02:17:38.094655 32571 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:38.094726 32571 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66de2e1e8879455ba92e59d7600a981f, State: Initialized, Role: FOLLOWER
I20260806 02:17:38.095214 32571 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66de2e1e8879455ba92e59d7600a981f" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39383 } }
I20260806 02:17:38.095345 32571 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:38.095431 32571 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:38.095554 32571 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:38.096472 32571 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66de2e1e8879455ba92e59d7600a981f" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39383 } }
I20260806 02:17:38.096815 32571 leader_election.cc:302] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66de2e1e8879455ba92e59d7600a981f; no voters:
I20260806 02:17:38.097162 32571 leader_election.cc:288] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:38.097386 32579 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:38.097663 32579 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [term 1 LEADER]: Becoming Leader. State: Replica: 66de2e1e8879455ba92e59d7600a981f, State: Running, Role: LEADER
I20260806 02:17:38.098002 32579 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66de2e1e8879455ba92e59d7600a981f" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39383 } }
I20260806 02:17:38.098567 32571 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:38.100030 32584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66de2e1e8879455ba92e59d7600a981f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66de2e1e8879455ba92e59d7600a981f" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39383 } } }
I20260806 02:17:38.100168 32584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:38.100015 32585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66de2e1e8879455ba92e59d7600a981f. Latest consensus state: current_term: 1 leader_uuid: "66de2e1e8879455ba92e59d7600a981f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66de2e1e8879455ba92e59d7600a981f" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39383 } } }
I20260806 02:17:38.100409 32585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f [sys.catalog]: This master's current role is: LEADER
W20260806 02:17:38.103653 32605 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:17:38.103739 32605 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:17:38.103797 32598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:38.104673 32598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:38.110270 32598 catalog_manager.cc:1347] Generated new cluster ID: 8c62f1a7bc8c4ce99e557869657d8d61
I20260806 02:17:38.110327 32598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:38.124552 32598 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:38.125888 32598 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:38.130266 32598 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66de2e1e8879455ba92e59d7600a981f: Generated new TSK 0
I20260806 02:17:38.131036 32598 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:17:38.164484 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39383
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:38.319067 32616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:38.319345 32616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:38.319398 32616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:38.323503 32616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:38.323561 32616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:38.323652 32616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:38.328877 32616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:38.330042 32616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:38.331135 32616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:38.340849 32626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:38.340929 32624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:38.341020 32616 server_base.cc:1034] running on GCE node
W20260806 02:17:38.340929 32622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:38.341614 32616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:38.342561 32616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:38.343772 32616 hybrid_clock.cc:648] HybridClock initialized: now 1785982658343742 us; error 47 us; skew 500 ppm
Aug 06 02:17:38 dist-test-slave-gkw7 krb5kdc[32449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:38.346797 32616 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:17:38.347781 32616 webserver.cc:460] Webserver started at http://127.26.189.129:43501/ using document root <none> and password file <none>
I20260806 02:17:38.348371 32616 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:38.348474 32616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:38.348733 32616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:38.350888 32616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "4c1b2ac06df742c99a06769496574cdb"
format_stamp: "Formatted at 2026-08-06 02:17:38 on dist-test-slave-gkw7"
server_key: "8d7715c34b169c9347cc10ff0a924433"
server_key_iv: "31ceb2c3e6c3b8eb57fb3274fb24fda4"
server_key_version: "encryptionkey@0"
I20260806 02:17:38.351505 32616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "4c1b2ac06df742c99a06769496574cdb"
format_stamp: "Formatted at 2026-08-06 02:17:38 on dist-test-slave-gkw7"
server_key: "8d7715c34b169c9347cc10ff0a924433"
server_key_iv: "31ceb2c3e6c3b8eb57fb3274fb24fda4"
server_key_version: "encryptionkey@0"
I20260806 02:17:38.355580 32616 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:38.358337 32635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:38.359683 32616 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:38.359841 32616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "4c1b2ac06df742c99a06769496574cdb"
format_stamp: "Formatted at 2026-08-06 02:17:38 on dist-test-slave-gkw7"
server_key: "8d7715c34b169c9347cc10ff0a924433"
server_key_iv: "31ceb2c3e6c3b8eb57fb3274fb24fda4"
server_key_version: "encryptionkey@0"
I20260806 02:17:38.359966 32616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:38.388602 32616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:38.391894 32616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:38.392129 32616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:38.392767 32616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:38.393674 32616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:38.393754 32616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:38.393831 32616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:38.393886 32616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:38.404121 32616 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:43557
I20260806 02:17:38.404246 330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:43557 every 8 connection(s)
I20260806 02:17:38.405092 32616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:38.412884 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 32616
I20260806 02:17:38.413023 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:17:38.413334 27382 external_mini_cluster.cc:1428] Setting key a75d3fe9613cb6b96de63ad520b86e19
Aug 06 02:17:38 dist-test-slave-gkw7 krb5kdc[32449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:38.419871 32577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:38.406992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:58469 (local address 127.26.189.190:39383)
0806 02:17:38.407126 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:38.407138 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:38.407945 (+ 807us) server_negotiation.cc:407] Connection header received
0806 02:17:38.409396 (+ 1451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:38.409400 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:38.409462 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:38.409567 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:38.410769 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.411325 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.412519 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.412889 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.413016 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:38.415884 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:38.415891 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:38.415897 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:38.415933 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:38.417467 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:38.418213 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:38.418216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:38.418217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:38.418296 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:38.418729 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:38.418731 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:38.418732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:38.418904 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:38.418982 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:38.419634 (+ 652us) server_negotiation.cc:299] Negotiation successful
0806 02:17:38.419751 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 02:17:38.421209 335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:38.407331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39383 (local address 127.26.189.129:58469)
0806 02:17:38.407794 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:38.407839 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:38.409165 (+ 1326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:38.409753 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:38.409760 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:38.410128 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:38.410614 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:38.410627 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.411460 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.411469 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:38.412374 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:38.412384 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.413168 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.413172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:38.413325 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:38.414054 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:38.414074 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:38.415715 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:38.417677 (+ 1962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:38.417686 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:38.417703 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:38.418103 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:38.418394 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:38.418399 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:38.418403 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:38.418625 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:38.419017 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:38.419026 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:38.419371 (+ 345us) client_negotiation.cc:769] Sending connection context
0806 02:17:38.419597 (+ 226us) client_negotiation.cc:240] Negotiation successful
0806 02:17:38.420006 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":120,"threads_started":1}
I20260806 02:17:38.422607 331 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39383
I20260806 02:17:38.422869 331 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:38.423404 331 heartbeater.cc:511] Master 127.26.189.190:39383 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
I20260806 02:17:38.425026 32519 ts_manager.cc:194] Registered new tserver with Master: 4c1b2ac06df742c99a06769496574cdb (127.26.189.129:43557)
I20260806 02:17:38.426235 32519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:58469
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:17:38.444968 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39383
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:38.558141 338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:38.558403 338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:38.558444 338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:38.562449 338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:38.562505 338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:38.562602 338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:38.568259 338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:38.569455 338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:38.570629 338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:38.580687 347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:38.580746 350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:38.580687 345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:38.580967 338 server_base.cc:1034] running on GCE node
I20260806 02:17:38.581498 338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:38.582208 338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:38.583379 338 hybrid_clock.cc:648] HybridClock initialized: now 1785982658583359 us; error 33 us; skew 500 ppm
Aug 06 02:17:38 dist-test-slave-gkw7 krb5kdc[32449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:38.586283 338 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:17:38.587178 338 webserver.cc:460] Webserver started at http://127.26.189.130:46277/ using document root <none> and password file <none>
I20260806 02:17:38.587752 338 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:38.587848 338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:38.588088 338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:38.590214 338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "deb2d7ae743e449d85f1e8b1ff103f80"
format_stamp: "Formatted at 2026-08-06 02:17:38 on dist-test-slave-gkw7"
server_key: "58ae6f24068f7f9012ea0798be150300"
server_key_iv: "ba068f8a0a13909943b382b74e3a89b0"
server_key_version: "encryptionkey@0"
I20260806 02:17:38.590786 338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "deb2d7ae743e449d85f1e8b1ff103f80"
format_stamp: "Formatted at 2026-08-06 02:17:38 on dist-test-slave-gkw7"
server_key: "58ae6f24068f7f9012ea0798be150300"
server_key_iv: "ba068f8a0a13909943b382b74e3a89b0"
server_key_version: "encryptionkey@0"
I20260806 02:17:38.594539 338 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:17:38.596869 362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:38.598136 338 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:17:38.598301 338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "deb2d7ae743e449d85f1e8b1ff103f80"
format_stamp: "Formatted at 2026-08-06 02:17:38 on dist-test-slave-gkw7"
server_key: "58ae6f24068f7f9012ea0798be150300"
server_key_iv: "ba068f8a0a13909943b382b74e3a89b0"
server_key_version: "encryptionkey@0"
I20260806 02:17:38.598414 338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:38.627594 338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:38.631031 338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:38.631247 338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:38.631943 338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:38.632804 338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:38.632877 338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:38.632951 338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:38.633003 338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:38.642853 338 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:35777
I20260806 02:17:38.642886 525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:35777 every 8 connection(s)
I20260806 02:17:38.643735 338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:38.652179 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 338
I20260806 02:17:38.652277 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:17:38.652570 27382 external_mini_cluster.cc:1428] Setting key 7284450e2ca555ba38c02db2943f292a
Aug 06 02:17:38 dist-test-slave-gkw7 krb5kdc[32449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:38.658756 32577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:38.645588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:44757 (local address 127.26.189.190:39383)
0806 02:17:38.645727 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:38.645731 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:38.646620 (+ 889us) server_negotiation.cc:407] Connection header received
0806 02:17:38.648075 (+ 1455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:38.648078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:38.648125 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:38.648204 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:38.649453 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.650051 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.651265 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.651477 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.651555 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:38.654436 (+ 2881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:38.654442 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:38.654447 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:38.654479 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:38.656261 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:38.656979 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:38.656982 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:38.656983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:38.657059 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:38.657565 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:38.657572 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:38.657576 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:38.657764 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:38.657843 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:38.658540 (+ 697us) server_negotiation.cc:299] Negotiation successful
0806 02:17:38.658636 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 02:17:38.660178 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:38.645941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39383 (local address 127.26.189.130:44757)
0806 02:17:38.646448 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:38.646497 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:38.647875 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:38.648393 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:38.648400 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:38.648801 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:38.649308 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:38.649323 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.650183 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.650186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:38.651151 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:38.651161 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.651627 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.651630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:38.651782 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:38.652469 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:38.652487 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:38.654263 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:38.656414 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:38.656423 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:38.656441 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:38.656873 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:38.657194 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:38.657200 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:38.657203 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:38.657420 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:38.657886 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:38.657897 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:38.658257 (+ 360us) client_negotiation.cc:769] Sending connection context
0806 02:17:38.658503 (+ 246us) client_negotiation.cc:240] Negotiation successful
0806 02:17:38.658892 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":112,"threads_started":1}
I20260806 02:17:38.661813 527 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39383
I20260806 02:17:38.662078 527 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:38.662571 527 heartbeater.cc:511] Master 127.26.189.190:39383 requested a full tablet report, sending...
I20260806 02:17:38.663762 32519 ts_manager.cc:194] Registered new tserver with Master: deb2d7ae743e449d85f1e8b1ff103f80 (127.26.189.130:35777)
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
I20260806 02:17:38.664762 32519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:44757
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:17:38.684877 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39383
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:38.798653 533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:38.798915 533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:38.798957 533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:38.803215 533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:38.803277 533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:38.803335 533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:38.808698 533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:38.809741 533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:38.810740 533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:38.820556 539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:38.820544 542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:38.820546 540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:38.820856 533 server_base.cc:1034] running on GCE node
I20260806 02:17:38.821302 533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:38.822063 533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:38.823268 533 hybrid_clock.cc:648] HybridClock initialized: now 1785982658823236 us; error 50 us; skew 500 ppm
Aug 06 02:17:38 dist-test-slave-gkw7 krb5kdc[32449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:38.826066 533 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:17:38.827085 533 webserver.cc:460] Webserver started at http://127.26.189.131:33891/ using document root <none> and password file <none>
I20260806 02:17:38.827721 533 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:38.827822 533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:38.828089 533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:38.830390 533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "b07d21a0dad5439193612cd39faf84d3"
format_stamp: "Formatted at 2026-08-06 02:17:38 on dist-test-slave-gkw7"
server_key: "ac97b9015bcbc6d269f2188176d56bab"
server_key_iv: "c494b6deb145121267096bc15464cfcc"
server_key_version: "encryptionkey@0"
I20260806 02:17:38.831084 533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "b07d21a0dad5439193612cd39faf84d3"
format_stamp: "Formatted at 2026-08-06 02:17:38 on dist-test-slave-gkw7"
server_key: "ac97b9015bcbc6d269f2188176d56bab"
server_key_iv: "c494b6deb145121267096bc15464cfcc"
server_key_version: "encryptionkey@0"
I20260806 02:17:38.834995 533 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:38.837611 552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:38.838876 533 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:17:38.839028 533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "b07d21a0dad5439193612cd39faf84d3"
format_stamp: "Formatted at 2026-08-06 02:17:38 on dist-test-slave-gkw7"
server_key: "ac97b9015bcbc6d269f2188176d56bab"
server_key_iv: "c494b6deb145121267096bc15464cfcc"
server_key_version: "encryptionkey@0"
I20260806 02:17:38.839178 533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:38.859437 533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:38.862751 533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:38.862962 533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:38.863572 533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:38.864480 533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:38.864552 533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:38.864627 533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:38.864670 533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:38.873885 533 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:37761
I20260806 02:17:38.873919 709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:37761 every 8 connection(s)
I20260806 02:17:38.874789 533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:38.881466 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 533
I20260806 02:17:38.881646 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:17:38.881963 27382 external_mini_cluster.cc:1428] Setting key 86bd932b71e1ecf843d832ab5cff4181
Aug 06 02:17:38 dist-test-slave-gkw7 krb5kdc[32449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:38.889034 32577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:38.876681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:43257 (local address 127.26.189.190:39383)
0806 02:17:38.876821 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:38.876825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:38.877654 (+ 829us) server_negotiation.cc:407] Connection header received
0806 02:17:38.879063 (+ 1409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:38.879065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:38.879113 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:38.879188 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:38.880344 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.880876 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.882168 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.882457 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.882583 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:38.885439 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:38.885442 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:38.885444 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:38.885468 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:38.886892 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:38.887428 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:38.887432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:38.887434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:38.887514 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:38.887875 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:38.887879 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:38.887881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:38.888072 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:38.888217 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:38.888736 (+ 519us) server_negotiation.cc:299] Negotiation successful
0806 02:17:38.888864 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 02:17:38.889904 713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:38.876990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39383 (local address 127.26.189.131:43257)
0806 02:17:38.877439 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:38.877481 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:38.878857 (+ 1376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:38.879367 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:38.879373 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:38.879727 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:38.880202 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:38.880214 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.880985 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.880987 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:38.882016 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:38.882026 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.882625 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.882629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:38.882852 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:38.883655 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:38.883675 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:38.885272 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:38.887025 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:38.887031 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:38.887047 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:38.887316 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:38.887608 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:38.887613 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:38.887615 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:38.887773 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:38.888215 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:38.888222 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:38.888458 (+ 236us) client_negotiation.cc:769] Sending connection context
0806 02:17:38.888678 (+ 220us) client_negotiation.cc:240] Negotiation successful
0806 02:17:38.889012 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":110,"threads_started":1}
I20260806 02:17:38.891028 711 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39383
I20260806 02:17:38.891292 711 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:38.891798 711 heartbeater.cc:511] Master 127.26.189.190:39383 requested a full tablet report, sending...
I20260806 02:17:38.892828 32519 ts_manager.cc:194] Registered new tserver with Master: b07d21a0dad5439193612cd39faf84d3 (127.26.189.131:37761)
I20260806 02:17:38.893414 32519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:43257
I20260806 02:17:38.896060 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 02:17:38 dist-test-slave-gkw7 krb5kdc[32449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 02:17:38 dist-test-slave-gkw7 krb5kdc[32449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.129@KRBTEST.COM
I20260806 02:17:38.924660 718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:38.914696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45222 (local address 127.26.189.129:43557)
0806 02:17:38.915028 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:38.915053 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:38.915078 (+ 25us) server_negotiation.cc:407] Connection header received
0806 02:17:38.915133 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:38.915139 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:38.915345 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:38.915475 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:38.916191 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.917136 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.918056 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.918479 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.918575 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:38.920994 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:38.921004 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:38.921019 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:38.921045 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:38.922787 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:38.923249 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:38.923255 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:38.923257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:38.923338 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:38.923630 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:38.923634 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:38.923636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:38.923892 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:38.924136 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:38.924321 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 02:17:38.924480 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":130,"threads_started":1}
Aug 06 02:17:38 dist-test-slave-gkw7 krb5kdc[32449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:38.941043 32577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:38.927569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56950 (local address 127.26.189.190:39383)
0806 02:17:38.927694 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:38.927698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:38.927774 (+ 76us) server_negotiation.cc:407] Connection header received
0806 02:17:38.927934 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:38.927936 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:38.927978 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:38.928048 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:38.928684 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.929257 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.930132 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:38.930388 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:38.930489 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:38.938062 (+ 7573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:38.938067 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:38.938071 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:38.938147 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:38.939504 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:38.939903 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:38.939906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:38.939907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:38.939986 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:38.940221 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:38.940223 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:38.940225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:38.940465 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:38.940580 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:38.940801 (+ 221us) server_negotiation.cc:299] Negotiation successful
0806 02:17:38.940909 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260806 02:17:38.941612 32519 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56950
I20260806 02:17:38.942332 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 32616
I20260806 02:17:38.956616 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 338
I20260806 02:17:38.967854 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 533
I20260806 02:17:38.976992 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 32465
2026-08-06T02:17:38Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2501 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:39 dist-test-slave-gkw7 krb5kdc[725](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:39 dist-test-slave-gkw7 krb5kdc[725](info): set up 2 sockets
Aug 06 02:17:39 dist-test-slave-gkw7 krb5kdc[725](info): commencing operation
krb5kdc: starting...
W20260806 02:17:40.264523 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:40 dist-test-slave-gkw7 krb5kdc[725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:17:40.397058 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:34925
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:34925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:40.511475 746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:40.511814 746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:40.511911 746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:40.515980 746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:40.516068 746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:40.516099 746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:40.516124 746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:40.516148 746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:40.521371 746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:34925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:34925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:40.522589 746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:40.523669 746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 02:17:40.532315 746 server_base.cc:1034] running on GCE node
W20260806 02:17:40.532307 752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:40.532279 757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:40.532275 751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:40.533102 746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:40.534341 746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:40.535539 746 hybrid_clock.cc:648] HybridClock initialized: now 1785982660535517 us; error 36 us; skew 500 ppm
Aug 06 02:17:40 dist-test-slave-gkw7 krb5kdc[725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:40.538479 746 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:17:40.539279 746 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:40.539465 746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:40.539729 746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:40.541945 746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "b67781eea80f4509b61e892a31d7a4ba"
format_stamp: "Formatted at 2026-08-06 02:17:40 on dist-test-slave-gkw7"
server_key: "33368ec62bc4efe42485bba66a7c422b"
server_key_iv: "8bf495fe16a5fa4b5428f5db3d410dcb"
server_key_version: "encryptionkey@0"
I20260806 02:17:40.542598 746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "b67781eea80f4509b61e892a31d7a4ba"
format_stamp: "Formatted at 2026-08-06 02:17:40 on dist-test-slave-gkw7"
server_key: "33368ec62bc4efe42485bba66a7c422b"
server_key_iv: "8bf495fe16a5fa4b5428f5db3d410dcb"
server_key_version: "encryptionkey@0"
I20260806 02:17:40.546617 746 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:40.549151 764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:40.550508 746 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:17:40.550670 746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "b67781eea80f4509b61e892a31d7a4ba"
format_stamp: "Formatted at 2026-08-06 02:17:40 on dist-test-slave-gkw7"
server_key: "33368ec62bc4efe42485bba66a7c422b"
server_key_iv: "8bf495fe16a5fa4b5428f5db3d410dcb"
server_key_version: "encryptionkey@0"
I20260806 02:17:40.550802 746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:40.560755 746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:40.563714 746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:40.563982 746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:40.571410 746 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:34925
I20260806 02:17:40.571727 840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:34925 every 8 connection(s)
I20260806 02:17:40.572180 746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:40.574138 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 746
I20260806 02:17:40.574301 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:40.574587 27382 external_mini_cluster.cc:1428] Setting key 191ca4ec01eec5ce0eaf918c40566801
I20260806 02:17:40.575335 841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:40.582439 841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba: Bootstrap starting.
Aug 06 02:17:40 dist-test-slave-gkw7 krb5kdc[725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:40.585016 841 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:40.586076 841 log.cc:824] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:40.588402 841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba: No bootstrap required, opened a new log
I20260806 02:17:40.590037 845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:40.576065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56542 (local address 127.26.189.190:34925)
0806 02:17:40.576514 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:40.576534 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:40.576578 (+ 44us) server_negotiation.cc:407] Connection header received
0806 02:17:40.577476 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:40.577500 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:40.577940 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:40.578329 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:40.579006 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:40.580495 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:40.581357 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:40.582065 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:40.582237 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:40.584923 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:40.584931 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:40.584949 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:40.584986 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:40.586918 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:40.587380 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:40.587386 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:40.587392 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:40.587529 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:40.587787 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:40.587790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:40.587791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:40.588293 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:40.588476 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:40.588783 (+ 307us) server_negotiation.cc:299] Negotiation successful
0806 02:17:40.589081 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":138,"threads_started":1}
I20260806 02:17:40.592738 841 raft_consensus.cc:348] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b67781eea80f4509b61e892a31d7a4ba" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 34925 } }
I20260806 02:17:40.592952 841 raft_consensus.cc:374] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:40.592986 841 raft_consensus.cc:729] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67781eea80f4509b61e892a31d7a4ba, State: Initialized, Role: FOLLOWER
I20260806 02:17:40.593344 841 consensus_queue.cc:260] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b67781eea80f4509b61e892a31d7a4ba" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 34925 } }
I20260806 02:17:40.593452 841 raft_consensus.cc:388] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:40.593495 841 raft_consensus.cc:482] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:40.593632 841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:40.594516 841 raft_consensus.cc:504] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b67781eea80f4509b61e892a31d7a4ba" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 34925 } }
I20260806 02:17:40.594888 841 leader_election.cc:302] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b67781eea80f4509b61e892a31d7a4ba; no voters:
I20260806 02:17:40.595252 841 leader_election.cc:288] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:40.595364 847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:40.595599 847 raft_consensus.cc:686] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [term 1 LEADER]: Becoming Leader. State: Replica: b67781eea80f4509b61e892a31d7a4ba, State: Running, Role: LEADER
I20260806 02:17:40.595921 847 consensus_queue.cc:237] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b67781eea80f4509b61e892a31d7a4ba" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 34925 } }
I20260806 02:17:40.596473 841 sys_catalog.cc:564] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:40.597049 847 sys_catalog.cc:455] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader b67781eea80f4509b61e892a31d7a4ba. Latest consensus state: current_term: 1 leader_uuid: "b67781eea80f4509b61e892a31d7a4ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b67781eea80f4509b61e892a31d7a4ba" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 34925 } } }
I20260806 02:17:40.597182 847 sys_catalog.cc:458] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:40.597616 849 sys_catalog.cc:455] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b67781eea80f4509b61e892a31d7a4ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b67781eea80f4509b61e892a31d7a4ba" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 34925 } } }
I20260806 02:17:40.597721 849 sys_catalog.cc:458] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:40.597736 854 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:40.601037 854 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:40.606562 854 catalog_manager.cc:1347] Generated new cluster ID: 5159ae148d2d4339a21c593dc9f02a4e
I20260806 02:17:40.606632 854 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:40.629575 854 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:40.630592 854 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:40.641402 854 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba: Generated new TSK 0
I20260806 02:17:40.642202 854 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:17:40.677479 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:34925
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:40.792801 876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:40.793103 876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:40.793175 876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:40.797266 876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:40.797348 876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:40.797439 876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:40.802902 876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:34925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:40.804020 876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:40.805073 876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:40.815037 888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:40.815084 884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:40.815084 885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:40.816143 876 server_base.cc:1034] running on GCE node
I20260806 02:17:40.816582 876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:40.817304 876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:40.818512 876 hybrid_clock.cc:648] HybridClock initialized: now 1785982660818500 us; error 37 us; skew 500 ppm
Aug 06 02:17:40 dist-test-slave-gkw7 krb5kdc[725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:40.821889 876 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:17:40.822793 876 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:40.822872 876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:40.823166 876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:40.825484 876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "31f30eeddcc84702ad900b6da9df1633"
format_stamp: "Formatted at 2026-08-06 02:17:40 on dist-test-slave-gkw7"
server_key: "288ec9cf0e03ba96f22a7443a7f68724"
server_key_iv: "8b48e1352f13b4ce918d5996616117ba"
server_key_version: "encryptionkey@0"
I20260806 02:17:40.826260 876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "31f30eeddcc84702ad900b6da9df1633"
format_stamp: "Formatted at 2026-08-06 02:17:40 on dist-test-slave-gkw7"
server_key: "288ec9cf0e03ba96f22a7443a7f68724"
server_key_iv: "8b48e1352f13b4ce918d5996616117ba"
server_key_version: "encryptionkey@0"
I20260806 02:17:40.830495 876 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 02:17:40.833134 895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:40.834522 876 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:40.834671 876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "31f30eeddcc84702ad900b6da9df1633"
format_stamp: "Formatted at 2026-08-06 02:17:40 on dist-test-slave-gkw7"
server_key: "288ec9cf0e03ba96f22a7443a7f68724"
server_key_iv: "8b48e1352f13b4ce918d5996616117ba"
server_key_version: "encryptionkey@0"
I20260806 02:17:40.834789 876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:40.858552 876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:40.862062 876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:40.862289 876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:40.862918 876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:40.863806 876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:40.863880 876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:40.863955 876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:40.864001 876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:40.873598 876 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:37355
I20260806 02:17:40.873629 1055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:37355 every 8 connection(s)
I20260806 02:17:40.874259 876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:40.875458 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 876
I20260806 02:17:40.875605 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:17:40.875934 27382 external_mini_cluster.cc:1428] Setting key 02a4e3e5242990bcd8005e698ddcad0e
Aug 06 02:17:40 dist-test-slave-gkw7 krb5kdc[725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:17:40.891459 845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:40.876667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:51623 (local address 127.26.189.190:34925)
0806 02:17:40.876847 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:40.876853 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:40.878072 (+ 1219us) server_negotiation.cc:407] Connection header received
0806 02:17:40.880371 (+ 2299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:40.880374 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:40.880436 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:40.880529 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:40.881947 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:40.882570 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:40.883863 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:40.884134 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:40.884258 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:40.887138 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:40.887141 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:40.887144 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:40.887172 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:40.888671 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:40.889310 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:40.889313 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:40.889314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:40.889394 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:40.889970 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:40.889975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:40.889976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:40.890285 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:40.890428 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:40.890968 (+ 540us) server_negotiation.cc:299] Negotiation successful
0806 02:17:40.891157 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 02:17:40.892037 1059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:40.877203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:34925 (local address 127.26.189.129:51623)
0806 02:17:40.877867 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:40.877931 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:40.880068 (+ 2137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:40.880737 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:40.880746 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:40.881147 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:40.881765 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:40.881783 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:40.882721 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:40.882724 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:40.883711 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:40.883721 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:40.884309 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:40.884313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:40.884509 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:40.885217 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:40.885235 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:40.886922 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:40.888823 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:40.888836 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:40.888850 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:40.889198 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:40.889514 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:40.889517 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:40.889519 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:40.889778 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:40.890419 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:40.890425 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:40.890673 (+ 248us) client_negotiation.cc:769] Sending connection context
0806 02:17:40.890838 (+ 165us) client_negotiation.cc:240] Negotiation successful
0806 02:17:40.891101 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":206,"threads_started":1}
I20260806 02:17:40.893608 1056 heartbeater.cc:347] Connected to a master server at 127.26.189.190:34925
I20260806 02:17:40.893927 1056 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:40.894474 1056 heartbeater.cc:511] Master 127.26.189.190:34925 requested a full tablet report, sending...
I20260806 02:17:40.896487 787 ts_manager.cc:194] Registered new tserver with Master: 31f30eeddcc84702ad900b6da9df1633 (127.26.189.129:37355)
I20260806 02:17:40.898015 787 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:51623
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:17:40.912508 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:34925
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:41.034088 1062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:41.034355 1062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:41.034401 1062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:41.038435 1062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:41.038496 1062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:41.038555 1062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:41.043815 1062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:34925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:41.044817 1062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:41.045876 1062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:41.055703 1069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:41.055763 1072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:41.055872 1062 server_base.cc:1034] running on GCE node
W20260806 02:17:41.055938 1074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:41.056383 1062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:41.057094 1062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:41.058312 1062 hybrid_clock.cc:648] HybridClock initialized: now 1785982661058277 us; error 47 us; skew 500 ppm
Aug 06 02:17:41 dist-test-slave-gkw7 krb5kdc[725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:41.061359 1062 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:17:41.062198 1062 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:41.062297 1062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:41.062541 1062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:41.064684 1062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "204deececcc34f80a51905116e0681e3"
format_stamp: "Formatted at 2026-08-06 02:17:41 on dist-test-slave-gkw7"
server_key: "8291c0e88f0b2da0056c438e6f87a200"
server_key_iv: "051bbb869a3ee7639b50be1db3c9568e"
server_key_version: "encryptionkey@0"
I20260806 02:17:41.065295 1062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "204deececcc34f80a51905116e0681e3"
format_stamp: "Formatted at 2026-08-06 02:17:41 on dist-test-slave-gkw7"
server_key: "8291c0e88f0b2da0056c438e6f87a200"
server_key_iv: "051bbb869a3ee7639b50be1db3c9568e"
server_key_version: "encryptionkey@0"
I20260806 02:17:41.069450 1062 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260806 02:17:41.072220 1080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:41.073737 1062 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:41.073879 1062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "204deececcc34f80a51905116e0681e3"
format_stamp: "Formatted at 2026-08-06 02:17:41 on dist-test-slave-gkw7"
server_key: "8291c0e88f0b2da0056c438e6f87a200"
server_key_iv: "051bbb869a3ee7639b50be1db3c9568e"
server_key_version: "encryptionkey@0"
I20260806 02:17:41.074003 1062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:41.094868 1062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:41.099072 1062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:41.099299 1062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:41.099951 1062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:41.100962 1062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:41.101039 1062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:41.101112 1062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:41.101167 1062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:41.110695 1062 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:35443
I20260806 02:17:41.110831 1250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:35443 every 8 connection(s)
I20260806 02:17:41.111399 1062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:41.120870 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 1062
I20260806 02:17:41.120992 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:17:41.121363 27382 external_mini_cluster.cc:1428] Setting key a8bbeac2a521078a2f4669a445ad882a
Aug 06 02:17:41 dist-test-slave-gkw7 krb5kdc[725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:41.126828 845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.113381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:32965 (local address 127.26.189.190:34925)
0806 02:17:41.113563 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:41.113571 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:41.114488 (+ 917us) server_negotiation.cc:407] Connection header received
0806 02:17:41.115914 (+ 1426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:41.115917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:41.115980 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:41.116090 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:41.117334 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.117968 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.119167 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.119403 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.119519 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.122421 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:41.122424 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:41.122426 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:41.122453 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:41.124426 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:41.124998 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:41.125005 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:41.125010 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:41.125148 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:41.125578 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:41.125582 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:41.125586 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:41.125809 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:41.125929 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:41.126511 (+ 582us) server_negotiation.cc:299] Negotiation successful
0806 02:17:41.126660 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 02:17:41.127898 1255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.113806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:34925 (local address 127.26.189.130:32965)
0806 02:17:41.114313 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:41.114359 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:41.115688 (+ 1329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:41.116284 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:41.116291 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:41.116674 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:41.117177 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.117191 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.118115 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.118119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.119022 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.119032 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.119568 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.119573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.119751 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.120394 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:41.120412 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:41.122234 (+ 1822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:41.124561 (+ 2327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:41.124566 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:41.124586 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:41.124866 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:41.125253 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:41.125256 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:41.125257 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:41.125443 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:41.125928 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:41.125937 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:41.126251 (+ 314us) client_negotiation.cc:769] Sending connection context
0806 02:17:41.126465 (+ 214us) client_negotiation.cc:240] Negotiation successful
0806 02:17:41.126830 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":128,"threads_started":1}
I20260806 02:17:41.129258 1251 heartbeater.cc:347] Connected to a master server at 127.26.189.190:34925
I20260806 02:17:41.129596 1251 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:41.130288 1251 heartbeater.cc:511] Master 127.26.189.190:34925 requested a full tablet report, sending...
I20260806 02:17:41.131798 787 ts_manager.cc:194] Registered new tserver with Master: 204deececcc34f80a51905116e0681e3 (127.26.189.130:35443)
I20260806 02:17:41.132752 787 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:32965
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:17:41.156311 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:34925
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:41.277444 1258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:41.277968 1258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:41.278077 1258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:41.282666 1258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:41.282768 1258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:41.282866 1258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:41.288393 1258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:34925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:41.289595 1258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:41.290689 1258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:41.300702 1271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:41.300688 1268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:41.300689 1269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:41.301154 1258 server_base.cc:1034] running on GCE node
I20260806 02:17:41.301708 1258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:41.302398 1258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:41.303570 1258 hybrid_clock.cc:648] HybridClock initialized: now 1785982661303551 us; error 33 us; skew 500 ppm
Aug 06 02:17:41 dist-test-slave-gkw7 krb5kdc[725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:41.306524 1258 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:17:41.307289 1258 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:41.307389 1258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:41.307639 1258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:41.309885 1258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "48656dd6192f4ad490a3dc9c132e4869"
format_stamp: "Formatted at 2026-08-06 02:17:41 on dist-test-slave-gkw7"
server_key: "44644f4aebcc3adf058624a43ccc5f95"
server_key_iv: "69d50688d413afd8d28e6823c6b56020"
server_key_version: "encryptionkey@0"
I20260806 02:17:41.310559 1258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "48656dd6192f4ad490a3dc9c132e4869"
format_stamp: "Formatted at 2026-08-06 02:17:41 on dist-test-slave-gkw7"
server_key: "44644f4aebcc3adf058624a43ccc5f95"
server_key_iv: "69d50688d413afd8d28e6823c6b56020"
server_key_version: "encryptionkey@0"
I20260806 02:17:41.314497 1258 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:41.316967 1277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:41.318333 1258 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:17:41.318480 1258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "48656dd6192f4ad490a3dc9c132e4869"
format_stamp: "Formatted at 2026-08-06 02:17:41 on dist-test-slave-gkw7"
server_key: "44644f4aebcc3adf058624a43ccc5f95"
server_key_iv: "69d50688d413afd8d28e6823c6b56020"
server_key_version: "encryptionkey@0"
I20260806 02:17:41.318601 1258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:41.333813 1258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:41.336966 1258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:41.337183 1258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:41.337867 1258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:41.338827 1258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:41.338899 1258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:41.338972 1258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:41.339027 1258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:41.348469 1258 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:40567
I20260806 02:17:41.348489 1442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:40567 every 8 connection(s)
I20260806 02:17:41.349095 1258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:41.354373 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 1258
I20260806 02:17:41.354529 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:17:41.354852 27382 external_mini_cluster.cc:1428] Setting key 6e4e6560c1e610f52fac0e8e16e675bf
Aug 06 02:17:41 dist-test-slave-gkw7 krb5kdc[725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:41.363492 845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.350936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:55173 (local address 127.26.189.190:34925)
0806 02:17:41.351075 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:41.351079 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:41.351907 (+ 828us) server_negotiation.cc:407] Connection header received
0806 02:17:41.353183 (+ 1276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:41.353185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:41.353241 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:41.353320 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:41.355039 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.355598 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.356887 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.357123 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.357238 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.359773 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:41.359777 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:41.359779 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:41.359805 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:41.361404 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:41.361994 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:41.361996 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:41.361998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:41.362075 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:41.362436 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:41.362439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:41.362440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:41.362645 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:41.362725 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:41.363259 (+ 534us) server_negotiation.cc:299] Negotiation successful
0806 02:17:41.363369 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 02:17:41.364387 1446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.351272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:34925 (local address 127.26.189.131:55173)
0806 02:17:41.351741 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:41.351783 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:41.352985 (+ 1202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:41.353516 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:41.353524 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:41.354118 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:41.354875 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.354899 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.355787 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.355790 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.356710 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.356755 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.357293 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.357297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.357472 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.358055 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:41.358071 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:41.359601 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:41.361584 (+ 1983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:41.361594 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:41.361618 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:41.361897 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:41.362166 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:41.362168 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:41.362170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:41.362337 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:41.362761 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:41.362767 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:41.363010 (+ 243us) client_negotiation.cc:769] Sending connection context
0806 02:17:41.363184 (+ 174us) client_negotiation.cc:240] Negotiation successful
0806 02:17:41.363463 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":115,"threads_started":1}
I20260806 02:17:41.365787 1443 heartbeater.cc:347] Connected to a master server at 127.26.189.190:34925
I20260806 02:17:41.366209 1443 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:41.366729 1443 heartbeater.cc:511] Master 127.26.189.190:34925 requested a full tablet report, sending...
I20260806 02:17:41.367905 787 ts_manager.cc:194] Registered new tserver with Master: 48656dd6192f4ad490a3dc9c132e4869 (127.26.189.131:40567)
I20260806 02:17:41.368629 787 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:55173
I20260806 02:17:41.369052 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:17:41.380051 845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.371097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56558 (local address 127.26.189.190:34925)
0806 02:17:41.371242 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:41.371246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:41.372661 (+ 1415us) server_negotiation.cc:407] Connection header received
0806 02:17:41.372742 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:41.372744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:41.372783 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:41.372849 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:41.373597 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.374106 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.375127 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.375378 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.375460 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.376905 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:41.376909 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:41.376911 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:41.376933 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:41.378472 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:41.378897 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:41.378900 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:41.378901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:41.378977 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:41.379213 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:41.379215 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:41.379217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:41.379431 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:41.379542 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:41.379741 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 02:17:41.379838 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 02:17:41.383020 787 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56558:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:17:41.386178 787 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:41.400964 1457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.394793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:35443 (local address 127.0.0.1:49498)
0806 02:17:41.395255 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:41.395311 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:41.395460 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:41.396511 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:41.396516 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:41.396545 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:41.396726 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.396737 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.398364 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.398367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.399522 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.399532 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.400368 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.400372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.400482 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.400518 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 02:17:41.400666 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 02:17:41.400800 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":98,"threads_started":1}
I20260806 02:17:41.400969 1463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.395338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49498 (local address 127.26.189.130:35443)
0806 02:17:41.395920 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:41.395934 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:41.395964 (+ 30us) server_negotiation.cc:407] Connection header received
0806 02:17:41.396099 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:41.396106 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:41.396331 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:41.396885 (+ 554us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:41.397056 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.398190 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.399662 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.400234 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.400383 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.400524 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:41.400699 (+ 175us) server_negotiation.cc:299] Negotiation successful
0806 02:17:41.400799 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":166,"threads_started":1}
I20260806 02:17:41.402244 1464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.396007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:37355 (local address 127.0.0.1:47554)
0806 02:17:41.396439 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:41.396454 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:41.396563 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:41.397274 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:41.397277 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:41.397298 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:41.397402 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.397408 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.398949 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.398952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.400293 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.400302 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.401759 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.401763 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.401903 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.401929 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 02:17:41.402002 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 02:17:41.402081 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":28,"spinlock_wait_cycles":10112,"thread_start_us":122,"threads_started":1}
I20260806 02:17:41.402699 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.396382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47554 (local address 127.26.189.129:37355)
0806 02:17:41.396789 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:41.396795 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:41.396815 (+ 20us) server_negotiation.cc:407] Connection header received
0806 02:17:41.396878 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:41.396882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:41.397111 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:41.397332 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:41.397492 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.398824 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.400440 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.401369 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.401506 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.401675 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:41.402444 (+ 769us) server_negotiation.cc:299] Negotiation successful
0806 02:17:41.402550 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":105,"threads_started":1}
I20260806 02:17:41.404287 1158 tablet_service.cc:1467] Processing CreateTablet for tablet 5c93a5108bf24bcdb45016bf3502a2fa (DEFAULT_TABLE table=test-table [id=bbca8cafb7f541678bfa922bdbc80c24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:41.405429 1158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c93a5108bf24bcdb45016bf3502a2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:41.405129 960 tablet_service.cc:1467] Processing CreateTablet for tablet 5c93a5108bf24bcdb45016bf3502a2fa (DEFAULT_TABLE table=test-table [id=bbca8cafb7f541678bfa922bdbc80c24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:41.406149 960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c93a5108bf24bcdb45016bf3502a2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:41.410343 1460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.394920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33390 (local address 127.26.189.131:40567)
0806 02:17:41.395835 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:41.395851 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:41.396113 (+ 262us) server_negotiation.cc:407] Connection header received
0806 02:17:41.396312 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:41.396317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:41.396494 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:41.396681 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:41.397133 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.398657 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.400440 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.401786 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.401924 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.409686 (+ 7762us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:41.410024 (+ 338us) server_negotiation.cc:299] Negotiation successful
0806 02:17:41.410173 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":792,"thread_start_us":122,"threads_started":1}
I20260806 02:17:41.411034 1459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.394801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:40567 (local address 127.0.0.1:33390)
0806 02:17:41.395955 (+ 1154us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:41.395968 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:41.396167 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:41.396857 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:41.396860 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:41.396877 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:41.397001 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.397007 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.398824 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.398828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.400275 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.400291 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.409676 (+ 9385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.409681 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.409808 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.409854 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 02:17:41.409953 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 02:17:41.410045 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1086,"mutex_wait_us":28,"thread_start_us":135,"threads_started":1}
I20260806 02:17:41.412580 1467 tablet_bootstrap.cc:492] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633: Bootstrap starting.
I20260806 02:17:41.413226 1468 tablet_bootstrap.cc:492] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3: Bootstrap starting.
I20260806 02:17:41.414615 1355 tablet_service.cc:1467] Processing CreateTablet for tablet 5c93a5108bf24bcdb45016bf3502a2fa (DEFAULT_TABLE table=test-table [id=bbca8cafb7f541678bfa922bdbc80c24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:41.415251 1467 tablet_bootstrap.cc:654] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:41.415505 1468 tablet_bootstrap.cc:654] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:41.415655 1355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c93a5108bf24bcdb45016bf3502a2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:41.416322 1467 log.cc:824] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:41.416961 1468 log.cc:824] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:41.418733 1467 tablet_bootstrap.cc:492] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633: No bootstrap required, opened a new log
I20260806 02:17:41.418959 1467 ts_tablet_manager.cc:1397] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260806 02:17:41.419140 1468 tablet_bootstrap.cc:492] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3: No bootstrap required, opened a new log
I20260806 02:17:41.419345 1468 ts_tablet_manager.cc:1397] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 02:17:41.422609 1474 tablet_bootstrap.cc:492] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869: Bootstrap starting.
I20260806 02:17:41.423725 1468 raft_consensus.cc:348] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48656dd6192f4ad490a3dc9c132e4869" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 40567 } } peers { permanent_uuid: "204deececcc34f80a51905116e0681e3" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35443 } } peers { permanent_uuid: "31f30eeddcc84702ad900b6da9df1633" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37355 } }
I20260806 02:17:41.424045 1468 raft_consensus.cc:374] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:41.424117 1468 raft_consensus.cc:729] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 204deececcc34f80a51905116e0681e3, State: Initialized, Role: FOLLOWER
I20260806 02:17:41.424069 1467 raft_consensus.cc:348] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48656dd6192f4ad490a3dc9c132e4869" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 40567 } } peers { permanent_uuid: "204deececcc34f80a51905116e0681e3" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35443 } } peers { permanent_uuid: "31f30eeddcc84702ad900b6da9df1633" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37355 } }
I20260806 02:17:41.424451 1467 raft_consensus.cc:374] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:41.424516 1467 raft_consensus.cc:729] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f30eeddcc84702ad900b6da9df1633, State: Initialized, Role: FOLLOWER
I20260806 02:17:41.424726 1468 consensus_queue.cc:260] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48656dd6192f4ad490a3dc9c132e4869" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 40567 } } peers { permanent_uuid: "204deececcc34f80a51905116e0681e3" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35443 } } peers { permanent_uuid: "31f30eeddcc84702ad900b6da9df1633" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37355 } }
I20260806 02:17:41.424957 1467 consensus_queue.cc:260] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48656dd6192f4ad490a3dc9c132e4869" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 40567 } } peers { permanent_uuid: "204deececcc34f80a51905116e0681e3" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35443 } } peers { permanent_uuid: "31f30eeddcc84702ad900b6da9df1633" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37355 } }
I20260806 02:17:41.425344 1474 tablet_bootstrap.cc:654] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:41.425631 1251 heartbeater.cc:503] Master 127.26.189.190:34925 was elected leader, sending a full tablet report...
I20260806 02:17:41.425945 1468 ts_tablet_manager.cc:1428] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 02:17:41.425945 1467 ts_tablet_manager.cc:1428] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 02:17:41.426334 1056 heartbeater.cc:503] Master 127.26.189.190:34925 was elected leader, sending a full tablet report...
I20260806 02:17:41.426786 1474 log.cc:824] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:41.428694 1474 tablet_bootstrap.cc:492] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869: No bootstrap required, opened a new log
I20260806 02:17:41.428916 1474 ts_tablet_manager.cc:1397] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:17:41.432780 1474 raft_consensus.cc:348] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48656dd6192f4ad490a3dc9c132e4869" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 40567 } } peers { permanent_uuid: "204deececcc34f80a51905116e0681e3" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35443 } } peers { permanent_uuid: "31f30eeddcc84702ad900b6da9df1633" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37355 } }
I20260806 02:17:41.433033 1474 raft_consensus.cc:374] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:41.433102 1474 raft_consensus.cc:729] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48656dd6192f4ad490a3dc9c132e4869, State: Initialized, Role: FOLLOWER
I20260806 02:17:41.433501 1474 consensus_queue.cc:260] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48656dd6192f4ad490a3dc9c132e4869" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 40567 } } peers { permanent_uuid: "204deececcc34f80a51905116e0681e3" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35443 } } peers { permanent_uuid: "31f30eeddcc84702ad900b6da9df1633" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37355 } }
I20260806 02:17:41.434204 1443 heartbeater.cc:503] Master 127.26.189.190:34925 was elected leader, sending a full tablet report...
I20260806 02:17:41.434562 1474 ts_tablet_manager.cc:1428] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:17:41.462623 1477 raft_consensus.cc:482] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:41.462883 1477 raft_consensus.cc:504] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48656dd6192f4ad490a3dc9c132e4869" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 40567 } } peers { permanent_uuid: "204deececcc34f80a51905116e0681e3" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35443 } } peers { permanent_uuid: "31f30eeddcc84702ad900b6da9df1633" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37355 } }
I20260806 02:17:41.464159 1477 leader_election.cc:288] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48656dd6192f4ad490a3dc9c132e4869 (127.26.189.131:40567), 204deececcc34f80a51905116e0681e3 (127.26.189.130:35443)
I20260806 02:17:41.470130 1463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.464606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:35139 (local address 127.26.189.130:35443)
0806 02:17:41.464779 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:41.464784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:41.465059 (+ 275us) server_negotiation.cc:407] Connection header received
0806 02:17:41.465232 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:41.465235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:41.465289 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:41.465384 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:41.465877 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.466692 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.468683 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.469303 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.469441 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.469497 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:41.469919 (+ 422us) server_negotiation.cc:299] Negotiation successful
0806 02:17:41.469996 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 02:17:41.470130 1460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.464706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:54505 (local address 127.26.189.131:40567)
0806 02:17:41.464829 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:41.464833 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:41.465128 (+ 295us) server_negotiation.cc:407] Connection header received
0806 02:17:41.465232 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:41.465235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:41.465289 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:41.465384 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:41.465877 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.466697 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.468677 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.469319 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.469455 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.469497 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:41.469919 (+ 422us) server_negotiation.cc:299] Negotiation successful
0806 02:17:41.469996 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 02:17:41.470218 1481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.464478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:35443 (local address 127.26.189.129:35139)
0806 02:17:41.464940 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:41.464957 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:41.465096 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:41.465438 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:41.465441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:41.465485 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:41.465736 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.465744 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.466832 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.466836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.468529 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.468542 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.469449 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.469453 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.469726 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.469803 (+ 77us) client_negotiation.cc:769] Sending connection context
0806 02:17:41.469885 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 02:17:41.470002 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":393,"spinlock_wait_cycles":8064,"thread_start_us":162,"threads_started":1}
I20260806 02:17:41.470229 1482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.464478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:40567 (local address 127.26.189.129:54505)
0806 02:17:41.465035 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:41.465049 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:41.465129 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:41.465438 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:41.465441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:41.465483 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:41.465736 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.465744 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.466832 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.466836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.468529 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:41.468542 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.469449 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.469454 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:41.469723 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.469804 (+ 81us) client_negotiation.cc:769] Sending connection context
0806 02:17:41.469885 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 02:17:41.470002 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"mutex_wait_us":354,"spinlock_wait_cycles":28288,"thread_start_us":136,"threads_started":1}
I20260806 02:17:41.471161 1182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c93a5108bf24bcdb45016bf3502a2fa" candidate_uuid: "31f30eeddcc84702ad900b6da9df1633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "204deececcc34f80a51905116e0681e3" is_pre_election: true
I20260806 02:17:41.471122 1379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c93a5108bf24bcdb45016bf3502a2fa" candidate_uuid: "31f30eeddcc84702ad900b6da9df1633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48656dd6192f4ad490a3dc9c132e4869" is_pre_election: true
I20260806 02:17:41.471491 1379 raft_consensus.cc:2454] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f30eeddcc84702ad900b6da9df1633 in term 0.
I20260806 02:17:41.471494 1182 raft_consensus.cc:2454] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f30eeddcc84702ad900b6da9df1633 in term 0.
I20260806 02:17:41.471993 898 leader_election.cc:302] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 204deececcc34f80a51905116e0681e3, 31f30eeddcc84702ad900b6da9df1633; no voters:
I20260806 02:17:41.472273 1477 raft_consensus.cc:2781] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:41.472383 1477 raft_consensus.cc:482] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:41.472445 1477 raft_consensus.cc:3037] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:41.473579 1477 raft_consensus.cc:504] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48656dd6192f4ad490a3dc9c132e4869" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 40567 } } peers { permanent_uuid: "204deececcc34f80a51905116e0681e3" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35443 } } peers { permanent_uuid: "31f30eeddcc84702ad900b6da9df1633" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37355 } }
I20260806 02:17:41.473953 1477 leader_election.cc:288] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [CANDIDATE]: Term 1 election: Requested vote from peers 48656dd6192f4ad490a3dc9c132e4869 (127.26.189.131:40567), 204deececcc34f80a51905116e0681e3 (127.26.189.130:35443)
I20260806 02:17:41.474320 1379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c93a5108bf24bcdb45016bf3502a2fa" candidate_uuid: "31f30eeddcc84702ad900b6da9df1633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48656dd6192f4ad490a3dc9c132e4869"
I20260806 02:17:41.474452 1379 raft_consensus.cc:3037] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:41.475556 1379 raft_consensus.cc:2454] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f30eeddcc84702ad900b6da9df1633 in term 1.
I20260806 02:17:41.475826 1182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c93a5108bf24bcdb45016bf3502a2fa" candidate_uuid: "31f30eeddcc84702ad900b6da9df1633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "204deececcc34f80a51905116e0681e3"
I20260806 02:17:41.475905 900 leader_election.cc:302] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f30eeddcc84702ad900b6da9df1633, 48656dd6192f4ad490a3dc9c132e4869; no voters:
I20260806 02:17:41.475961 1182 raft_consensus.cc:3037] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:41.476080 1477 raft_consensus.cc:2781] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:41.476346 1477 raft_consensus.cc:686] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [term 1 LEADER]: Becoming Leader. State: Replica: 31f30eeddcc84702ad900b6da9df1633, State: Running, Role: LEADER
I20260806 02:17:41.476706 1477 consensus_queue.cc:237] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48656dd6192f4ad490a3dc9c132e4869" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 40567 } } peers { permanent_uuid: "204deececcc34f80a51905116e0681e3" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35443 } } peers { permanent_uuid: "31f30eeddcc84702ad900b6da9df1633" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37355 } }
I20260806 02:17:41.477249 1182 raft_consensus.cc:2454] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f30eeddcc84702ad900b6da9df1633 in term 1.
I20260806 02:17:41.480309 787 catalog_manager.cc:5495] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31f30eeddcc84702ad900b6da9df1633 (127.26.189.129). New cstate: current_term: 1 leader_uuid: "31f30eeddcc84702ad900b6da9df1633" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48656dd6192f4ad490a3dc9c132e4869" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "204deececcc34f80a51905116e0681e3" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31f30eeddcc84702ad900b6da9df1633" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37355 } health_report { overall_health: HEALTHY } } }
I20260806 02:17:41.499800 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.495800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47558 (local address 127.26.189.129:37355)
0806 02:17:41.495951 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:41.495958 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:41.495976 (+ 18us) server_negotiation.cc:407] Connection header received
0806 02:17:41.496120 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:41.496123 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:41.496189 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:41.496305 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:41.496567 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.497098 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.498233 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:41.498479 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:41.498624 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:41.498939 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:41.499375 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:41.499517 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:41.499586 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 02:17:41.499648 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 02:17:41.506253 1182 raft_consensus.cc:1261] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3 [term 1 FOLLOWER]: Refusing update from remote peer 31f30eeddcc84702ad900b6da9df1633: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:41.506258 1379 raft_consensus.cc:1261] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869 [term 1 FOLLOWER]: Refusing update from remote peer 31f30eeddcc84702ad900b6da9df1633: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:41.507067 1483 consensus_queue.cc:1035] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48656dd6192f4ad490a3dc9c132e4869" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:41.507248 1477 consensus_queue.cc:1035] T 5c93a5108bf24bcdb45016bf3502a2fa P 31f30eeddcc84702ad900b6da9df1633 [LEADER]: Connected to new peer: Peer: permanent_uuid: "204deececcc34f80a51905116e0681e3" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:41.513943 1487 mvcc.cc:205] Tried to move back new op lower bound from 7315384981521309696 to 7315384981412347904. Current Snapshot: MvccSnapshot[applied={T|T < 7315384981521309696}]
I20260806 02:17:41.516033 1490 mvcc.cc:205] Tried to move back new op lower bound from 7315384981521309696 to 7315384981412347904. Current Snapshot: MvccSnapshot[applied={T|T < 7315384981521309696}]
I20260806 02:17:41.516346 1488 mvcc.cc:205] Tried to move back new op lower bound from 7315384981521309696 to 7315384981412347904. Current Snapshot: MvccSnapshot[applied={T|T < 7315384981521309696}]
I20260806 02:17:41.524122 786 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56558:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:41.524320 786 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56558:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:41.527052 786 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b67781eea80f4509b61e892a31d7a4ba: Sending DeleteTablet for 3 replicas of tablet 5c93a5108bf24bcdb45016bf3502a2fa
I20260806 02:17:41.528002 1158 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c93a5108bf24bcdb45016bf3502a2fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:41 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:49498
I20260806 02:17:41.528002 960 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c93a5108bf24bcdb45016bf3502a2fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:41 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:47554
I20260806 02:17:41.528178 1355 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c93a5108bf24bcdb45016bf3502a2fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:41 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:33390
I20260806 02:17:41.528630 1500 tablet_replica.cc:330] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3: stopping tablet replica
I20260806 02:17:41.528842 1501 tablet_replica.cc:330] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869: stopping tablet replica
I20260806 02:17:41.529033 1500 raft_consensus.cc:2229] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:41.529289 1501 raft_consensus.cc:2229] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:41.529408 1500 raft_consensus.cc:2258] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:41.529448 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 876
I20260806 02:17:41.529740 1501 raft_consensus.cc:2258] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:41.540171 1501 ts_tablet_manager.cc:1905] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:41.540171 1500 ts_tablet_manager.cc:1905] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:41.543058 1501 ts_tablet_manager.cc:1918] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:41.543058 1500 ts_tablet_manager.cc:1918] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:41.543177 1501 log.cc:1196] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/5c93a5108bf24bcdb45016bf3502a2fa
I20260806 02:17:41.543177 1500 log.cc:1196] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/5c93a5108bf24bcdb45016bf3502a2fa
I20260806 02:17:41.543553 1501 ts_tablet_manager.cc:1939] T 5c93a5108bf24bcdb45016bf3502a2fa P 48656dd6192f4ad490a3dc9c132e4869: Deleting consensus metadata
I20260806 02:17:41.543579 1500 ts_tablet_manager.cc:1939] T 5c93a5108bf24bcdb45016bf3502a2fa P 204deececcc34f80a51905116e0681e3: Deleting consensus metadata
I20260806 02:17:41.544945 768 catalog_manager.cc:4841] TS 48656dd6192f4ad490a3dc9c132e4869 (127.26.189.131:40567): tablet 5c93a5108bf24bcdb45016bf3502a2fa (table test-table [id=bbca8cafb7f541678bfa922bdbc80c24]) successfully deleted
I20260806 02:17:41.544948 767 catalog_manager.cc:4841] TS 204deececcc34f80a51905116e0681e3 (127.26.189.130:35443): tablet 5c93a5108bf24bcdb45016bf3502a2fa (table test-table [id=bbca8cafb7f541678bfa922bdbc80c24]) successfully deleted
W20260806 02:17:41.545678 768 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:37355 (error 108)
I20260806 02:17:41.545972 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 1062
I20260806 02:17:41.550587 1459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.550124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:37355 (local address 127.0.0.1:47560)
0806 02:17:41.550371 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:41.550465 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
W20260806 02:17:41.550874 768 catalog_manager.cc:4584] TS 31f30eeddcc84702ad900b6da9df1633 (127.26.189.129:37355): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5c93a5108bf24bcdb45016bf3502a2fa: Network error: Client connection negotiation failed: client connection to 127.26.189.129:37355: connect: Connection refused (error 111)
I20260806 02:17:41.557654 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 1258
I20260806 02:17:41.572758 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 746
2026-08-06T02:17:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2597 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T02:17:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:41Z Disabled control of system clock
I20260806 02:17:41.613409 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:36789
--webserver_interface=127.26.189.190
--webserver_port=0
--builtin_ntp_servers=127.26.189.148:40017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:36789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 02:17:41.732861 1508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:41.733129 1508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:41.733167 1508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:41.737165 1508 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:41.737241 1508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:41.737257 1508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:41.737274 1508 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:41.737290 1508 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:41.742287 1508 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:40017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:36789
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:36789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:41.743462 1508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:41.744948 1508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:41.754046 1521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:41.754106 1519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:41.754076 1516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:41.754056 1508 server_base.cc:1034] running on GCE node
I20260806 02:17:41.755015 1508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:41.756246 1508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:41.757472 1508 hybrid_clock.cc:648] HybridClock initialized: now 1785982661757454 us; error 27 us; skew 500 ppm
I20260806 02:17:41.759649 1508 webserver.cc:460] Webserver started at http://127.26.189.190:40735/ using document root <none> and password file <none>
I20260806 02:17:41.760290 1508 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:41.760391 1508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:41.760650 1508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:41.762889 1508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "1f70203422af4448af442073256947fa"
format_stamp: "Formatted at 2026-08-06 02:17:41 on dist-test-slave-gkw7"
server_key: "42534613e38c477c496b9e0d906be32f"
server_key_iv: "d49304715dea62f8efc2f6ddefd1125e"
server_key_version: "encryptionkey@0"
I20260806 02:17:41.763520 1508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "1f70203422af4448af442073256947fa"
format_stamp: "Formatted at 2026-08-06 02:17:41 on dist-test-slave-gkw7"
server_key: "42534613e38c477c496b9e0d906be32f"
server_key_iv: "d49304715dea62f8efc2f6ddefd1125e"
server_key_version: "encryptionkey@0"
I20260806 02:17:41.767513 1508 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:41.770308 1528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:41.771550 1508 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:41.771713 1508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "1f70203422af4448af442073256947fa"
format_stamp: "Formatted at 2026-08-06 02:17:41 on dist-test-slave-gkw7"
server_key: "42534613e38c477c496b9e0d906be32f"
server_key_iv: "d49304715dea62f8efc2f6ddefd1125e"
server_key_version: "encryptionkey@0"
I20260806 02:17:41.771842 1508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:41.776809 1508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:41.777496 1508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:41.777736 1508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:41.785142 1508 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:36789
I20260806 02:17:41.785168 1596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:36789 every 8 connection(s)
I20260806 02:17:41.786239 1508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:41.789897 1597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:41.790550 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 1508
I20260806 02:17:41.790685 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:41.791023 27382 external_mini_cluster.cc:1428] Setting key 68796c39c9a66d566341b427ba41c905
I20260806 02:17:41.796660 1597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa: Bootstrap starting.
I20260806 02:17:41.799117 1597 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:41.800125 1597 log.cc:824] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:41.800984 1600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:41.792493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41768 (local address 127.26.189.190:36789)
0806 02:17:41.793215 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:41.793235 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:41.793275 (+ 40us) server_negotiation.cc:407] Connection header received
0806 02:17:41.793995 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:41.794014 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:41.794397 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:41.794703 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:41.799480 (+ 4777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:41.799486 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:41.799499 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:41.799513 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:41.799582 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:41.799602 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:41.799713 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:41.799866 (+ 153us) server_negotiation.cc:299] Negotiation successful
0806 02:17:41.800211 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":150,"threads_started":1}
I20260806 02:17:41.802326 1597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa: No bootstrap required, opened a new log
I20260806 02:17:41.806002 1597 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f70203422af4448af442073256947fa" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36789 } }
I20260806 02:17:41.806252 1597 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:41.806288 1597 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f70203422af4448af442073256947fa, State: Initialized, Role: FOLLOWER
I20260806 02:17:41.806789 1597 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f70203422af4448af442073256947fa" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36789 } }
I20260806 02:17:41.806922 1597 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:41.806998 1597 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:41.807116 1597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:41.808113 1597 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f70203422af4448af442073256947fa" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36789 } }
I20260806 02:17:41.808523 1597 leader_election.cc:302] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f70203422af4448af442073256947fa; no voters:
I20260806 02:17:41.808869 1597 leader_election.cc:288] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:41.809006 1604 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:41.809284 1604 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [term 1 LEADER]: Becoming Leader. State: Replica: 1f70203422af4448af442073256947fa, State: Running, Role: LEADER
I20260806 02:17:41.809690 1604 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f70203422af4448af442073256947fa" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36789 } }
I20260806 02:17:41.810276 1597 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:41.811662 1608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f70203422af4448af442073256947fa. Latest consensus state: current_term: 1 leader_uuid: "1f70203422af4448af442073256947fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f70203422af4448af442073256947fa" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36789 } } }
I20260806 02:17:41.811692 1606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f70203422af4448af442073256947fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f70203422af4448af442073256947fa" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36789 } } }
I20260806 02:17:41.811792 1608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:41.811805 1606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:41.812186 1618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:41.815244 1618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:41.821625 1618 catalog_manager.cc:1347] Generated new cluster ID: c54a0eb7277140b690cd24a6f6b268a1
I20260806 02:17:41.821707 1618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:41.848398 1618 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:41.848800 1618 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:41.856647 1618 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa: Generated new TSK 0
I20260806 02:17:41.857434 1618 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:17:41.863030 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36789
--builtin_ntp_servers=127.26.189.148:40017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 02:17:41.988790 1633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:41.989197 1633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:41.989286 1633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:41.996500 1633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:41.996603 1633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:41.996719 1633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:42.005201 1633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:40017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:42.006814 1633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:42.008826 1633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:42.021598 1644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:42.021581 1639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:42.021625 1641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:42.026813 1633 server_base.cc:1034] running on GCE node
I20260806 02:17:42.027320 1633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:42.028066 1633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:42.029312 1633 hybrid_clock.cc:648] HybridClock initialized: now 1785982662029271 us; error 60 us; skew 500 ppm
I20260806 02:17:42.032051 1633 webserver.cc:460] Webserver started at http://127.26.189.129:44811/ using document root <none> and password file <none>
I20260806 02:17:42.032676 1633 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:42.032742 1633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:42.032974 1633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:42.035176 1633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "8415d928b2e24739b98305309c4453ba"
format_stamp: "Formatted at 2026-08-06 02:17:42 on dist-test-slave-gkw7"
server_key: "470f88453c93b65cdd89db83e060563b"
server_key_iv: "56bbf583b63c93a08871973e4f3d0efc"
server_key_version: "encryptionkey@0"
I20260806 02:17:42.035769 1633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "8415d928b2e24739b98305309c4453ba"
format_stamp: "Formatted at 2026-08-06 02:17:42 on dist-test-slave-gkw7"
server_key: "470f88453c93b65cdd89db83e060563b"
server_key_iv: "56bbf583b63c93a08871973e4f3d0efc"
server_key_version: "encryptionkey@0"
I20260806 02:17:42.039654 1633 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260806 02:17:42.042379 1653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:42.043756 1633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 02:17:42.043924 1633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "8415d928b2e24739b98305309c4453ba"
format_stamp: "Formatted at 2026-08-06 02:17:42 on dist-test-slave-gkw7"
server_key: "470f88453c93b65cdd89db83e060563b"
server_key_iv: "56bbf583b63c93a08871973e4f3d0efc"
server_key_version: "encryptionkey@0"
I20260806 02:17:42.044051 1633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:42.048764 1633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:42.049399 1633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:42.049679 1633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:42.050242 1633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:42.051191 1633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:42.051265 1633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:42.051337 1633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:42.051383 1633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:42.061086 1633 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:43389
I20260806 02:17:42.061159 1801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:43389 every 8 connection(s)
I20260806 02:17:42.062125 1633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:42.068766 1600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.064035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:49533 (local address 127.26.189.190:36789)
0806 02:17:42.064232 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:42.064236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:42.065408 (+ 1172us) server_negotiation.cc:407] Connection header received
0806 02:17:42.066978 (+ 1570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:42.066981 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:42.067021 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:42.067139 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:42.068367 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:42.068371 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:42.068373 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:42.068385 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:42.068406 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:42.068414 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:42.068495 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:42.068619 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 02:17:42.068658 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 02:17:42.069792 1809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.064448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36789 (local address 127.26.189.129:49533)
0806 02:17:42.065246 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:42.065293 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:42.066749 (+ 1456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:42.067380 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:42.067387 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:42.067490 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:42.068067 (+ 577us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:17:42.068068 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:42.068111 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:17:42.068212 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:42.068493 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:42.068500 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:42.068505 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 02:17:42.068638 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 02:17:42.068875 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":128,"threads_started":1}
I20260806 02:17:42.071065 1807 heartbeater.cc:347] Connected to a master server at 127.26.189.190:36789
I20260806 02:17:42.071343 1807 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:42.071766 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 1633
I20260806 02:17:42.071821 1807 heartbeater.cc:511] Master 127.26.189.190:36789 requested a full tablet report, sending...
I20260806 02:17:42.071921 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:17:42.072230 27382 external_mini_cluster.cc:1428] Setting key 6d25a26f16b99c76f7a3f1a9ca4a7c11
I20260806 02:17:42.073494 1547 ts_manager.cc:194] Registered new tserver with Master: 8415d928b2e24739b98305309c4453ba (127.26.189.129:43389)
I20260806 02:17:42.074466 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36789
--builtin_ntp_servers=127.26.189.148:40017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 02:17:42.192888 1811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:42.193207 1811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:42.193284 1811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:42.197288 1811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:42.197404 1811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:42.197510 1811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:42.202497 1811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:40017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:42.203709 1811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:42.205196 1811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:42.215526 1823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:42.215544 1821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:42.215715 1811 server_base.cc:1034] running on GCE node
W20260806 02:17:42.215544 1820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:42.216259 1811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:42.216914 1811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:42.218104 1811 hybrid_clock.cc:648] HybridClock initialized: now 1785982662218091 us; error 26 us; skew 500 ppm
I20260806 02:17:42.220007 1811 webserver.cc:460] Webserver started at http://127.26.189.130:34469/ using document root <none> and password file <none>
I20260806 02:17:42.220602 1811 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:42.220710 1811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:42.220961 1811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:42.223196 1811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "a6e42451b32f4905a593f17fb7ddb6a8"
format_stamp: "Formatted at 2026-08-06 02:17:42 on dist-test-slave-gkw7"
server_key: "1ef5ebf36951796826eea31e18431b85"
server_key_iv: "356e97b7f74bc17e3800ad018f889ed7"
server_key_version: "encryptionkey@0"
I20260806 02:17:42.223791 1811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "a6e42451b32f4905a593f17fb7ddb6a8"
format_stamp: "Formatted at 2026-08-06 02:17:42 on dist-test-slave-gkw7"
server_key: "1ef5ebf36951796826eea31e18431b85"
server_key_iv: "356e97b7f74bc17e3800ad018f889ed7"
server_key_version: "encryptionkey@0"
I20260806 02:17:42.227561 1811 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 02:17:42.230181 1831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:42.231480 1811 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:17:42.231622 1811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "a6e42451b32f4905a593f17fb7ddb6a8"
format_stamp: "Formatted at 2026-08-06 02:17:42 on dist-test-slave-gkw7"
server_key: "1ef5ebf36951796826eea31e18431b85"
server_key_iv: "356e97b7f74bc17e3800ad018f889ed7"
server_key_version: "encryptionkey@0"
I20260806 02:17:42.231755 1811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:42.236361 1811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:42.236970 1811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:42.237159 1811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:42.237824 1811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:42.238741 1811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:42.238813 1811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:42.238885 1811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:42.238930 1811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:42.247861 1811 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:37681
I20260806 02:17:42.247887 1992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:37681 every 8 connection(s)
I20260806 02:17:42.248813 1811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:42.252004 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 1811
I20260806 02:17:42.252151 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:17:42.252442 27382 external_mini_cluster.cc:1428] Setting key 34dfc1d9437b53420cc48934326931af
I20260806 02:17:42.254755 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36789
--builtin_ntp_servers=127.26.189.148:40017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 02:17:42.255743 1600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.250796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:53111 (local address 127.26.189.190:36789)
0806 02:17:42.250954 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:42.250959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:42.251991 (+ 1032us) server_negotiation.cc:407] Connection header received
0806 02:17:42.253636 (+ 1645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:42.253639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:42.253688 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:42.253793 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:42.255209 (+ 1416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:42.255212 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:42.255215 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:42.255228 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:42.255252 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:42.255261 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:42.255370 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:42.255529 (+ 159us) server_negotiation.cc:299] Negotiation successful
0806 02:17:42.255575 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 02:17:42.256616 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.251175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36789 (local address 127.26.189.130:53111)
0806 02:17:42.251841 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:42.251882 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:42.253336 (+ 1454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:42.254004 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:42.254014 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:42.254140 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:42.254836 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:17:42.254840 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:42.254904 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:17:42.255011 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:42.255357 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:42.255366 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:42.255374 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 02:17:42.255573 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 02:17:42.255833 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":110,"threads_started":1}
I20260806 02:17:42.257930 1993 heartbeater.cc:347] Connected to a master server at 127.26.189.190:36789
I20260806 02:17:42.258210 1993 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:42.258646 1993 heartbeater.cc:511] Master 127.26.189.190:36789 requested a full tablet report, sending...
I20260806 02:17:42.259765 1547 ts_manager.cc:194] Registered new tserver with Master: a6e42451b32f4905a593f17fb7ddb6a8 (127.26.189.130:37681)
W20260806 02:17:42.379812 1997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:42.380136 1997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:42.380230 1997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:42.384737 1997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:42.384840 1997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:42.384991 1997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:42.390635 1997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:40017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:42.391968 1997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:42.393591 1997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:42.405092 2009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:42.405072 2006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:42.405097 2005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:42.405380 1997 server_base.cc:1034] running on GCE node
I20260806 02:17:42.405972 1997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:42.406719 1997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:42.407917 1997 hybrid_clock.cc:648] HybridClock initialized: now 1785982662407882 us; error 47 us; skew 500 ppm
I20260806 02:17:42.410324 1997 webserver.cc:460] Webserver started at http://127.26.189.131:41829/ using document root <none> and password file <none>
I20260806 02:17:42.410950 1997 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:42.411083 1997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:42.411398 1997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:42.414086 1997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "f3d908b89486490390a502aa10fe80fe"
format_stamp: "Formatted at 2026-08-06 02:17:42 on dist-test-slave-gkw7"
server_key: "786821ba83031afca7c4313ae07573e1"
server_key_iv: "e2bcfbeea0b1d312b91466b4627bee73"
server_key_version: "encryptionkey@0"
I20260806 02:17:42.414767 1997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "f3d908b89486490390a502aa10fe80fe"
format_stamp: "Formatted at 2026-08-06 02:17:42 on dist-test-slave-gkw7"
server_key: "786821ba83031afca7c4313ae07573e1"
server_key_iv: "e2bcfbeea0b1d312b91466b4627bee73"
server_key_version: "encryptionkey@0"
I20260806 02:17:42.419015 1997 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:42.421960 2019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:42.423605 1997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:42.423749 1997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "f3d908b89486490390a502aa10fe80fe"
format_stamp: "Formatted at 2026-08-06 02:17:42 on dist-test-slave-gkw7"
server_key: "786821ba83031afca7c4313ae07573e1"
server_key_iv: "e2bcfbeea0b1d312b91466b4627bee73"
server_key_version: "encryptionkey@0"
I20260806 02:17:42.423904 1997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:42.429877 1997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:42.430743 1997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:42.430969 1997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:42.431751 1997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:42.433161 1997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:42.433235 1997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:42.433314 1997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:42.433357 1997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:42.444372 2180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:45553 every 8 connection(s)
I20260806 02:17:42.444370 1997 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:45553
I20260806 02:17:42.445897 1997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:42.453153 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 1997
I20260806 02:17:42.453316 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:17:42.453442 1600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.448572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:39391 (local address 127.26.189.190:36789)
0806 02:17:42.448820 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:42.448825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:42.450027 (+ 1202us) server_negotiation.cc:407] Connection header received
0806 02:17:42.451474 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:42.451477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:42.451516 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:42.451601 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:42.452902 (+ 1301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:42.452906 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:42.452909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:42.452923 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:42.452948 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:42.452963 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:42.453076 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:42.453246 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 02:17:42.453295 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260806 02:17:42.453737 27382 external_mini_cluster.cc:1428] Setting key 52420b90a92930d68dee1b10ca5f59cb
I20260806 02:17:42.454622 2183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.449085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36789 (local address 127.26.189.131:39391)
0806 02:17:42.449866 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:42.449911 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:42.451237 (+ 1326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:42.451796 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:42.451803 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:42.451900 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:42.452580 (+ 680us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:17:42.452588 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:42.452632 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:17:42.452705 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:42.453069 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:42.453078 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:42.453085 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 02:17:42.453290 (+ 205us) client_negotiation.cc:240] Negotiation successful
0806 02:17:42.453573 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":118,"threads_started":1}
I20260806 02:17:42.455896 2181 heartbeater.cc:347] Connected to a master server at 127.26.189.190:36789
I20260806 02:17:42.456143 2181 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:42.456602 2181 heartbeater.cc:511] Master 127.26.189.190:36789 requested a full tablet report, sending...
I20260806 02:17:42.457666 1546 ts_manager.cc:194] Registered new tserver with Master: f3d908b89486490390a502aa10fe80fe (127.26.189.131:45553)
I20260806 02:17:42.468643 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:17:42.473026 1600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.471106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41778 (local address 127.26.189.190:36789)
0806 02:17:42.471292 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:42.471297 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:42.471442 (+ 145us) server_negotiation.cc:407] Connection header received
0806 02:17:42.471639 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:42.471641 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:42.471678 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:42.471780 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:42.472579 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:42.472582 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:42.472585 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:42.472597 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:42.472637 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:42.472645 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:42.472739 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:42.472823 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 02:17:42.472869 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 02:17:42.476365 1546 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41778:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:17:42.480218 1546 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:42.494014 2194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.490801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:43389 (local address 127.0.0.1:46158)
0806 02:17:42.491750 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:42.491766 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:42.491854 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:42.492264 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:42.492270 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:42.492350 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:42.492978 (+ 628us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:17:42.492981 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:42.493005 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:17:42.493077 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:42.493532 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:42.493564 (+ 32us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:42.493580 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 02:17:42.493740 (+ 160us) client_negotiation.cc:240] Negotiation successful
0806 02:17:42.493821 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"thread_start_us":107,"threads_started":1}
I20260806 02:17:42.494335 2202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.491004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46158 (local address 127.26.189.129:43389)
0806 02:17:42.491713 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:42.491722 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:42.491858 (+ 136us) server_negotiation.cc:407] Connection header received
0806 02:17:42.491949 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:42.491953 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:42.492096 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:42.492256 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:42.493293 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:42.493301 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:42.493314 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:42.493327 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:42.493372 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:42.493406 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:42.493520 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:42.494076 (+ 556us) server_negotiation.cc:299] Negotiation successful
0806 02:17:42.494165 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":101,"threads_started":1}
I20260806 02:17:42.494519 2195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.490048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:37681 (local address 127.0.0.1:52930)
0806 02:17:42.491162 (+ 1114us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:42.491224 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:42.491342 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:42.493023 (+ 1681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:42.493027 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:42.493043 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:42.493733 (+ 690us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:17:42.493735 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:42.493748 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:17:42.493777 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:42.494228 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:42.494235 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:42.494242 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 02:17:42.494328 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 02:17:42.494376 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":873,"thread_start_us":81,"threads_started":1}
I20260806 02:17:42.494974 2200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.490282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:45553 (local address 127.0.0.1:57178)
0806 02:17:42.491391 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:42.491406 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:42.491486 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:42.493244 (+ 1758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:42.493250 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:42.493272 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:42.493895 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:17:42.493896 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:42.493907 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:17:42.493932 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:42.494723 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:42.494727 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:42.494730 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 02:17:42.494816 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 02:17:42.494852 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1039,"thread_start_us":127,"threads_started":1}
I20260806 02:17:42.495038 2199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.490351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52930 (local address 127.26.189.130:37681)
0806 02:17:42.491716 (+ 1365us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:42.491729 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:42.491757 (+ 28us) server_negotiation.cc:407] Connection header received
0806 02:17:42.491825 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:42.491832 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:42.492083 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:42.492252 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:42.493933 (+ 1681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:42.493939 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:42.493951 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:42.493963 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:42.494009 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:42.494046 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:42.494179 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:42.494805 (+ 626us) server_negotiation.cc:299] Negotiation successful
0806 02:17:42.494879 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1245,"thread_start_us":170,"threads_started":1}
I20260806 02:17:42.495522 2203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.491290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57178 (local address 127.26.189.131:45553)
0806 02:17:42.492154 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:42.492169 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:42.492195 (+ 26us) server_negotiation.cc:407] Connection header received
0806 02:17:42.492250 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:42.492255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:42.492464 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:42.492613 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:42.494423 (+ 1810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:42.494430 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:42.494442 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:42.494455 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:42.494498 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:42.494533 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:42.494675 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:42.495273 (+ 598us) server_negotiation.cc:299] Negotiation successful
0806 02:17:42.495348 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":734,"thread_start_us":163,"threads_started":1}
I20260806 02:17:42.497612 1715 tablet_service.cc:1467] Processing CreateTablet for tablet e3996147ea49420f87ef71a8e87456b4 (DEFAULT_TABLE table=test-table [id=b8163139f8f44c5589d8e7055e3265b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:42.498067 1900 tablet_service.cc:1467] Processing CreateTablet for tablet e3996147ea49420f87ef71a8e87456b4 (DEFAULT_TABLE table=test-table [id=b8163139f8f44c5589d8e7055e3265b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:42.498402 2085 tablet_service.cc:1467] Processing CreateTablet for tablet e3996147ea49420f87ef71a8e87456b4 (DEFAULT_TABLE table=test-table [id=b8163139f8f44c5589d8e7055e3265b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:42.498859 1715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3996147ea49420f87ef71a8e87456b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:42.499060 1900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3996147ea49420f87ef71a8e87456b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:42.499262 2085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3996147ea49420f87ef71a8e87456b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:42.506192 2204 tablet_bootstrap.cc:492] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe: Bootstrap starting.
I20260806 02:17:42.507052 2206 tablet_bootstrap.cc:492] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8: Bootstrap starting.
I20260806 02:17:42.507493 2209 tablet_bootstrap.cc:492] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba: Bootstrap starting.
I20260806 02:17:42.508917 2204 tablet_bootstrap.cc:654] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:42.508947 2206 tablet_bootstrap.cc:654] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:42.509560 2209 tablet_bootstrap.cc:654] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:42.509887 2206 log.cc:824] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:42.509887 2204 log.cc:824] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:42.510352 2209 log.cc:824] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:42.512171 2204 tablet_bootstrap.cc:492] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe: No bootstrap required, opened a new log
I20260806 02:17:42.512171 2206 tablet_bootstrap.cc:492] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8: No bootstrap required, opened a new log
I20260806 02:17:42.512387 2204 ts_tablet_manager.cc:1397] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:17:42.512431 2206 ts_tablet_manager.cc:1397] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:17:42.512792 2209 tablet_bootstrap.cc:492] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba: No bootstrap required, opened a new log
I20260806 02:17:42.512997 2209 ts_tablet_manager.cc:1397] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 02:17:42.516582 2209 raft_consensus.cc:348] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 37681 } } peers { permanent_uuid: "f3d908b89486490390a502aa10fe80fe" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45553 } } peers { permanent_uuid: "8415d928b2e24739b98305309c4453ba" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 43389 } }
I20260806 02:17:42.516844 2209 raft_consensus.cc:374] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:42.516901 2209 raft_consensus.cc:729] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8415d928b2e24739b98305309c4453ba, State: Initialized, Role: FOLLOWER
I20260806 02:17:42.517158 2206 raft_consensus.cc:348] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 37681 } } peers { permanent_uuid: "f3d908b89486490390a502aa10fe80fe" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45553 } } peers { permanent_uuid: "8415d928b2e24739b98305309c4453ba" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 43389 } }
I20260806 02:17:42.517433 2206 raft_consensus.cc:374] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:42.517341 2209 consensus_queue.cc:260] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 37681 } } peers { permanent_uuid: "f3d908b89486490390a502aa10fe80fe" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45553 } } peers { permanent_uuid: "8415d928b2e24739b98305309c4453ba" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 43389 } }
I20260806 02:17:42.517500 2206 raft_consensus.cc:729] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e42451b32f4905a593f17fb7ddb6a8, State: Initialized, Role: FOLLOWER
I20260806 02:17:42.518000 2206 consensus_queue.cc:260] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 37681 } } peers { permanent_uuid: "f3d908b89486490390a502aa10fe80fe" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45553 } } peers { permanent_uuid: "8415d928b2e24739b98305309c4453ba" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 43389 } }
I20260806 02:17:42.518159 1807 heartbeater.cc:503] Master 127.26.189.190:36789 was elected leader, sending a full tablet report...
I20260806 02:17:42.518219 2204 raft_consensus.cc:348] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 37681 } } peers { permanent_uuid: "f3d908b89486490390a502aa10fe80fe" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45553 } } peers { permanent_uuid: "8415d928b2e24739b98305309c4453ba" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 43389 } }
I20260806 02:17:42.518471 2204 raft_consensus.cc:374] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:42.518476 2209 ts_tablet_manager.cc:1428] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 02:17:42.518522 2204 raft_consensus.cc:729] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d908b89486490390a502aa10fe80fe, State: Initialized, Role: FOLLOWER
I20260806 02:17:42.518968 2206 ts_tablet_manager.cc:1428] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260806 02:17:42.518905 2204 consensus_queue.cc:260] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 37681 } } peers { permanent_uuid: "f3d908b89486490390a502aa10fe80fe" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45553 } } peers { permanent_uuid: "8415d928b2e24739b98305309c4453ba" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 43389 } }
I20260806 02:17:42.519302 1993 heartbeater.cc:503] Master 127.26.189.190:36789 was elected leader, sending a full tablet report...
I20260806 02:17:42.519783 2204 ts_tablet_manager.cc:1428] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 02:17:42.520083 2181 heartbeater.cc:503] Master 127.26.189.190:36789 was elected leader, sending a full tablet report...
W20260806 02:17:42.563393 1808 tablet.cc:2369] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:17:42.583566 2214 raft_consensus.cc:482] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:42.583861 2214 raft_consensus.cc:504] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 37681 } } peers { permanent_uuid: "f3d908b89486490390a502aa10fe80fe" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45553 } } peers { permanent_uuid: "8415d928b2e24739b98305309c4453ba" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 43389 } }
I20260806 02:17:42.585067 2214 leader_election.cc:288] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d908b89486490390a502aa10fe80fe (127.26.189.131:45553), 8415d928b2e24739b98305309c4453ba (127.26.189.129:43389)
I20260806 02:17:42.587628 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.585433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:45553 (local address 127.26.189.130:38831)
0806 02:17:42.585628 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:42.585643 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:42.585756 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:42.586372 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:42.586375 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:42.586390 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:42.586945 (+ 555us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:17:42.586949 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:42.586964 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:17:42.586998 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:42.587329 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:42.587332 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:42.587336 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 02:17:42.587434 (+ 98us) client_negotiation.cc:240] Negotiation successful
0806 02:17:42.587476 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 02:17:42.587656 2203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.585694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:38831 (local address 127.26.189.131:45553)
0806 02:17:42.585841 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:42.585847 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:42.585866 (+ 19us) server_negotiation.cc:407] Connection header received
0806 02:17:42.586200 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:42.586203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:42.586239 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:42.586349 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:42.587170 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:42.587173 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:42.587176 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:42.587189 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:42.587214 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:42.587226 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:42.587317 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:42.587465 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 02:17:42.587514 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 02:17:42.587749 2202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.585948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:58297 (local address 127.26.189.129:43389)
0806 02:17:42.586144 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:42.586149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:42.586271 (+ 122us) server_negotiation.cc:407] Connection header received
0806 02:17:42.586418 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:42.586421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:42.586461 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:42.586550 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:42.587324 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:42.587327 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:42.587330 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:42.587343 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:42.587370 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:42.587383 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:42.587471 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:42.587563 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 02:17:42.587600 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 02:17:42.588004 2216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.585790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:43389 (local address 127.26.189.130:58297)
0806 02:17:42.586162 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:42.586177 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:42.586301 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:42.586570 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:42.586573 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:42.586587 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:42.587123 (+ 536us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:17:42.587125 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:42.587138 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:17:42.587166 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:42.587473 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:42.587476 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:42.587479 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 02:17:42.587565 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 02:17:42.587613 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":142,"threads_started":1}
I20260806 02:17:42.588622 2117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3996147ea49420f87ef71a8e87456b4" candidate_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d908b89486490390a502aa10fe80fe" is_pre_election: true
I20260806 02:17:42.588641 1746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3996147ea49420f87ef71a8e87456b4" candidate_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8415d928b2e24739b98305309c4453ba" is_pre_election: true
I20260806 02:17:42.588929 2117 raft_consensus.cc:2454] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6e42451b32f4905a593f17fb7ddb6a8 in term 0.
I20260806 02:17:42.588938 1746 raft_consensus.cc:2454] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6e42451b32f4905a593f17fb7ddb6a8 in term 0.
I20260806 02:17:42.589409 1833 leader_election.cc:302] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6e42451b32f4905a593f17fb7ddb6a8, f3d908b89486490390a502aa10fe80fe; no voters:
I20260806 02:17:42.589732 2214 raft_consensus.cc:2781] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:42.589843 2214 raft_consensus.cc:482] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:42.589900 2214 raft_consensus.cc:3037] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:42.638716 2214 raft_consensus.cc:504] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 37681 } } peers { permanent_uuid: "f3d908b89486490390a502aa10fe80fe" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45553 } } peers { permanent_uuid: "8415d928b2e24739b98305309c4453ba" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 43389 } }
I20260806 02:17:42.639264 2214 leader_election.cc:288] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [CANDIDATE]: Term 1 election: Requested vote from peers f3d908b89486490390a502aa10fe80fe (127.26.189.131:45553), 8415d928b2e24739b98305309c4453ba (127.26.189.129:43389)
I20260806 02:17:42.639870 1746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3996147ea49420f87ef71a8e87456b4" candidate_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8415d928b2e24739b98305309c4453ba"
I20260806 02:17:42.639876 2117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3996147ea49420f87ef71a8e87456b4" candidate_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d908b89486490390a502aa10fe80fe"
I20260806 02:17:42.640053 2117 raft_consensus.cc:3037] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:42.640053 1746 raft_consensus.cc:3037] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:42.641336 1746 raft_consensus.cc:2454] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e42451b32f4905a593f17fb7ddb6a8 in term 1.
I20260806 02:17:42.641775 1833 leader_election.cc:302] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8415d928b2e24739b98305309c4453ba, a6e42451b32f4905a593f17fb7ddb6a8; no voters:
I20260806 02:17:42.641829 2117 raft_consensus.cc:2454] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e42451b32f4905a593f17fb7ddb6a8 in term 1.
I20260806 02:17:42.642012 2214 raft_consensus.cc:2781] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:42.642298 2214 raft_consensus.cc:686] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 1 LEADER]: Becoming Leader. State: Replica: a6e42451b32f4905a593f17fb7ddb6a8, State: Running, Role: LEADER
I20260806 02:17:42.642729 2214 consensus_queue.cc:237] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 37681 } } peers { permanent_uuid: "f3d908b89486490390a502aa10fe80fe" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45553 } } peers { permanent_uuid: "8415d928b2e24739b98305309c4453ba" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 43389 } }
I20260806 02:17:42.646390 1546 catalog_manager.cc:5495] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6e42451b32f4905a593f17fb7ddb6a8 (127.26.189.130). New cstate: current_term: 1 leader_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e42451b32f4905a593f17fb7ddb6a8" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 37681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3d908b89486490390a502aa10fe80fe" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8415d928b2e24739b98305309c4453ba" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260806 02:17:42.688912 2199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.687154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52936 (local address 127.26.189.130:37681)
0806 02:17:42.687320 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:42.687324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:42.687370 (+ 46us) server_negotiation.cc:407] Connection header received
0806 02:17:42.687459 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:42.687462 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:42.687527 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:42.687605 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:42.688442 (+ 837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:42.688446 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:42.688448 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:42.688461 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:42.688484 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:42.688494 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:42.688592 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:42.688752 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 02:17:42.688795 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 02:17:42.695881 2117 raft_consensus.cc:1261] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe [term 1 FOLLOWER]: Refusing update from remote peer a6e42451b32f4905a593f17fb7ddb6a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:42.695881 1746 raft_consensus.cc:1261] T e3996147ea49420f87ef71a8e87456b4 P 8415d928b2e24739b98305309c4453ba [term 1 FOLLOWER]: Refusing update from remote peer a6e42451b32f4905a593f17fb7ddb6a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:42.696702 2220 consensus_queue.cc:1035] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8415d928b2e24739b98305309c4453ba" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 02:17:42.696933 2182 tablet.cc:2369] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:17:42.696929 2214 consensus_queue.cc:1035] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d908b89486490390a502aa10fe80fe" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:42.705435 2224 mvcc.cc:205] Tried to move back new op lower bound from 7315384986393980928 to 7315384986187763712. Current Snapshot: MvccSnapshot[applied={T|T < 7315384986393980928}]
I20260806 02:17:42.713117 1547 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:42.713353 1547 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:42.715885 1547 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f70203422af4448af442073256947fa: Sending DeleteTablet for 3 replicas of tablet e3996147ea49420f87ef71a8e87456b4
I20260806 02:17:42.716719 1900 tablet_service.cc:1514] Processing DeleteTablet for tablet e3996147ea49420f87ef71a8e87456b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:42 UTC) from {username='slave'} at 127.0.0.1:52930
I20260806 02:17:42.716864 2085 tablet_service.cc:1514] Processing DeleteTablet for tablet e3996147ea49420f87ef71a8e87456b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:42 UTC) from {username='slave'} at 127.0.0.1:57178
I20260806 02:17:42.717226 2239 tablet_replica.cc:330] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8: stopping tablet replica
I20260806 02:17:42.717396 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 1633
I20260806 02:17:42.717619 2239 raft_consensus.cc:2229] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:17:42.718031 2239 raft_consensus.cc:2258] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:42.721146 2239 ts_tablet_manager.cc:1905] T e3996147ea49420f87ef71a8e87456b4 P a6e42451b32f4905a593f17fb7ddb6a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:42.729235 2241 tablet_replica.cc:330] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe: stopping tablet replica
I20260806 02:17:42.729786 2241 raft_consensus.cc:2229] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:42.730186 2241 raft_consensus.cc:2258] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 02:17:42.731731 1531 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:43389 (error 108)
I20260806 02:17:42.731875 2241 ts_tablet_manager.cc:1905] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:42.732877 2200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.732526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:43389 (local address 127.0.0.1:46162)
0806 02:17:42.732694 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:42.732782 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:43389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 02:17:42.732892 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 1811
W20260806 02:17:42.738377 1531 catalog_manager.cc:4584] TS 8415d928b2e24739b98305309c4453ba (127.26.189.129:43389): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e3996147ea49420f87ef71a8e87456b4: Network error: Client connection negotiation failed: client connection to 127.26.189.129:43389: connect: Connection refused (error 111)
I20260806 02:17:42.741959 2241 ts_tablet_manager.cc:1918] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:42.742122 2241 log.cc:1196] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/e3996147ea49420f87ef71a8e87456b4
I20260806 02:17:42.742513 2241 ts_tablet_manager.cc:1939] T e3996147ea49420f87ef71a8e87456b4 P f3d908b89486490390a502aa10fe80fe: Deleting consensus metadata
I20260806 02:17:42.745803 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 1997
I20260806 02:17:42.748771 2200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:42.745942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:37681 (local address 127.0.0.1:52946)
0806 02:17:42.748596 (+ 2654us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:42.748663 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.130:37681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2536}
I20260806 02:17:42.787703 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 1508
2026-08-06T02:17:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1213 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 02:17:42.816680 27382 mini_oidc.cc:152] Starting JWKS server
I20260806 02:17:42.818570 27382 webserver.cc:460] Webserver started at https://127.0.0.1:35285/ using document root <none> and password file <none>
I20260806 02:17:42.818720 27382 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 02:17:42.818938 27382 webserver.cc:460] Webserver started at http://127.0.0.1:36929/ using document root <none> and password file <none>
2026-08-06T02:17:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:42Z Disabled control of system clock
I20260806 02:17:42.829061 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:33749
--webserver_interface=127.26.189.190
--webserver_port=0
--builtin_ntp_servers=127.26.189.148:45813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:33749
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35285/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/testchainca.cert with env {}
W20260806 02:17:42.950320 2250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:42.950641 2250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:42.950687 2250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:42.954778 2250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:42.954833 2250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:42.954849 2250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:42.954866 2250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:42.954881 2250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 02:17:42.954897 2250 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 02:17:42.954910 2250 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35285/jwks.json
I20260806 02:17:42.960522 2250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:33749
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:33749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35285/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:42.961705 2250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:42.962744 2250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:42.972200 2259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:42.972186 2261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:42.972362 2250 server_base.cc:1034] running on GCE node
W20260806 02:17:42.972553 2258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:42.973232 2250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:42.974733 2250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:42.975976 2250 hybrid_clock.cc:648] HybridClock initialized: now 1785982662975961 us; error 46 us; skew 500 ppm
I20260806 02:17:42.978322 2250 webserver.cc:460] Webserver started at http://127.26.189.190:40703/ using document root <none> and password file <none>
I20260806 02:17:42.978963 2250 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:42.979060 2250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:42.979316 2250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:42.981616 2250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "14d0667bff224af0a4cfe649eddd4f98"
format_stamp: "Formatted at 2026-08-06 02:17:42 on dist-test-slave-gkw7"
server_key: "20f7d8d3a568f679321228b2ed55021a"
server_key_iv: "2701a0325ae88840b212b04af33d3d40"
server_key_version: "encryptionkey@0"
I20260806 02:17:42.982340 2250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "14d0667bff224af0a4cfe649eddd4f98"
format_stamp: "Formatted at 2026-08-06 02:17:42 on dist-test-slave-gkw7"
server_key: "20f7d8d3a568f679321228b2ed55021a"
server_key_iv: "2701a0325ae88840b212b04af33d3d40"
server_key_version: "encryptionkey@0"
I20260806 02:17:42.986923 2250 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260806 02:17:42.989686 2271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:42.991326 2250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 02:17:42.991482 2250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "14d0667bff224af0a4cfe649eddd4f98"
format_stamp: "Formatted at 2026-08-06 02:17:42 on dist-test-slave-gkw7"
server_key: "20f7d8d3a568f679321228b2ed55021a"
server_key_iv: "2701a0325ae88840b212b04af33d3d40"
server_key_version: "encryptionkey@0"
I20260806 02:17:42.991607 2250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:43.020021 2250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:43.021080 2250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:43.021346 2250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:43.029626 2250 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:33749
I20260806 02:17:43.029651 2334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:33749 every 8 connection(s)
I20260806 02:17:43.030726 2250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:43.034332 2335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:43.036199 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 2250
I20260806 02:17:43.036316 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:43.036620 27382 external_mini_cluster.cc:1428] Setting key 0addf2f98f42dc5318380298c77f2830
I20260806 02:17:43.041630 2335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98: Bootstrap starting.
I20260806 02:17:43.044729 2335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:43.045653 2335 log.cc:824] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:43.046885 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:43.038222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33478 (local address 127.26.189.190:33749)
0806 02:17:43.038869 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:43.038885 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:43.038954 (+ 69us) server_negotiation.cc:407] Connection header received
0806 02:17:43.039657 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:43.039677 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:43.040134 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:43.040433 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:43.040891 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.041981 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.043323 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.043866 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.043990 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:43.044946 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:43.044953 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:43.044972 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:43.045409 (+ 437us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:43.045466 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:43.045488 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:43.045624 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:43.045818 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 02:17:43.046136 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":155,"threads_started":1}
I20260806 02:17:43.047966 2335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98: No bootstrap required, opened a new log
I20260806 02:17:43.050529 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:17:43.053025 2335 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14d0667bff224af0a4cfe649eddd4f98" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33749 } }
I20260806 02:17:43.053299 2335 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:43.053385 2335 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14d0667bff224af0a4cfe649eddd4f98, State: Initialized, Role: FOLLOWER
I20260806 02:17:43.053903 2335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14d0667bff224af0a4cfe649eddd4f98" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33749 } }
I20260806 02:17:43.054040 2335 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:43.054137 2335 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:43.054287 2335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:43.151676 2335 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14d0667bff224af0a4cfe649eddd4f98" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33749 } }
I20260806 02:17:43.152276 2335 leader_election.cc:302] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14d0667bff224af0a4cfe649eddd4f98; no voters:
I20260806 02:17:43.152740 2335 leader_election.cc:288] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:43.152899 2340 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:43.153224 2340 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [term 1 LEADER]: Becoming Leader. State: Replica: 14d0667bff224af0a4cfe649eddd4f98, State: Running, Role: LEADER
I20260806 02:17:43.153654 2340 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14d0667bff224af0a4cfe649eddd4f98" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33749 } }
I20260806 02:17:43.154413 2335 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:43.155661 2342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14d0667bff224af0a4cfe649eddd4f98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14d0667bff224af0a4cfe649eddd4f98" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33749 } } }
I20260806 02:17:43.155814 2342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:43.156299 2343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14d0667bff224af0a4cfe649eddd4f98. Latest consensus state: current_term: 1 leader_uuid: "14d0667bff224af0a4cfe649eddd4f98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14d0667bff224af0a4cfe649eddd4f98" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33749 } } }
I20260806 02:17:43.156502 2343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:43.157298 2359 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:43.160688 2359 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:43.166944 2359 catalog_manager.cc:1347] Generated new cluster ID: 245570b6d9c14cc18b4274364118f7fd
I20260806 02:17:43.167021 2359 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:43.178673 2359 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:43.179943 2359 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:43.193485 2359 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14d0667bff224af0a4cfe649eddd4f98: Generated new TSK 0
I20260806 02:17:43.194507 2359 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 02:17:43.242678 2381 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 02:17:43.242856 2381 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 02:17:43.243606 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:43.222353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33480 (local address 127.26.189.190:33749)
0806 02:17:43.222626 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:43.222634 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:43.223001 (+ 367us) server_negotiation.cc:407] Connection header received
0806 02:17:43.223371 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:43.223378 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:43.223449 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:43.223571 (+ 122us) server_negotiation.cc:226] Negotiated authn=JWT
0806 02:17:43.223896 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.224750 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.227754 (+ 3004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.228133 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.228220 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:43.228777 (+ 557us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 02:17:43.243101 (+ 14324us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35285/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 02:17:43.243424 (+ 323us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33480: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35285/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":112}
W20260806 02:17:43.243706 2338 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33480: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35285/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260806 02:17:43.245137 2380 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:17:43.222259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:33749 (local address 127.0.0.1:33480)
0806 02:17:43.222901 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:43.222917 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:43.223124 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:43.223612 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:43.223615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:43.223636 (+ 21us) client_negotiation.cc:189] Negotiated authn=JWT
0806 02:17:43.223774 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:43.223782 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.226478 (+ 2696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.226482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:43.227579 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:43.227592 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.228415 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.228418 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:43.228490 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:43.228537 (+ 47us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 02:17:43.243397 (+ 14860us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35285/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 02:17:43.243611 (+ 214us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.189.190:33749: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35285/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":123,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.26.189.190:33749: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35285/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 02:17:43.246007 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 2250
2026-08-06T02:17:43Z chronyd exiting
I20260806 02:17:43.304287 27382 test_util.cc:175] -----------------------------------------------
I20260806 02:17:43.304391 27382 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785982634882397-27382-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (489 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 02:17:43.305488 27382 mini_oidc.cc:152] Starting JWKS server
I20260806 02:17:43.306423 27382 webserver.cc:460] Webserver started at https://127.0.0.1:45043/ using document root <none> and password file <none>
I20260806 02:17:43.306505 27382 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 02:17:43.306715 27382 webserver.cc:460] Webserver started at http://127.0.0.1:33527/ using document root <none> and password file <none>
2026-08-06T02:17:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:43Z Disabled control of system clock
I20260806 02:17:43.317360 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:38885
--webserver_interface=127.26.189.190
--webserver_port=0
--builtin_ntp_servers=127.26.189.148:45951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:38885
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45043/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/testchainca.cert with env {}
W20260806 02:17:43.433832 2387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:43.434116 2387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:43.434156 2387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:43.438189 2387 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:43.438252 2387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:43.438268 2387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:43.438285 2387 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:43.438300 2387 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 02:17:43.438316 2387 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 02:17:43.438330 2387 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45043/jwks.json
I20260806 02:17:43.443909 2387 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:38885
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:38885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45043/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:43.445127 2387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:43.446328 2387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:43.456213 2394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:43.456202 2399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:43.456180 2395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:43.456446 2387 server_base.cc:1034] running on GCE node
I20260806 02:17:43.457177 2387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:43.458482 2387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:43.459659 2387 hybrid_clock.cc:648] HybridClock initialized: now 1785982663459644 us; error 39 us; skew 500 ppm
I20260806 02:17:43.461827 2387 webserver.cc:460] Webserver started at http://127.26.189.190:38451/ using document root <none> and password file <none>
I20260806 02:17:43.462451 2387 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:43.462517 2387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:43.462743 2387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:43.464953 2387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "8a0611ab056541bb97d01655576dcd52"
format_stamp: "Formatted at 2026-08-06 02:17:43 on dist-test-slave-gkw7"
server_key: "29a1012c16ad18581f58618d2ee3869f"
server_key_iv: "440966d0ac404154ee6ae40271e7539a"
server_key_version: "encryptionkey@0"
I20260806 02:17:43.465665 2387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "8a0611ab056541bb97d01655576dcd52"
format_stamp: "Formatted at 2026-08-06 02:17:43 on dist-test-slave-gkw7"
server_key: "29a1012c16ad18581f58618d2ee3869f"
server_key_iv: "440966d0ac404154ee6ae40271e7539a"
server_key_version: "encryptionkey@0"
I20260806 02:17:43.469736 2387 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:43.472576 2408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:43.474030 2387 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:43.474196 2387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "8a0611ab056541bb97d01655576dcd52"
format_stamp: "Formatted at 2026-08-06 02:17:43 on dist-test-slave-gkw7"
server_key: "29a1012c16ad18581f58618d2ee3869f"
server_key_iv: "440966d0ac404154ee6ae40271e7539a"
server_key_version: "encryptionkey@0"
I20260806 02:17:43.474325 2387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:43.490532 2387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:43.491318 2387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:43.491537 2387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:43.499262 2387 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:38885
I20260806 02:17:43.499276 2480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:38885 every 8 connection(s)
I20260806 02:17:43.500705 2387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:43.503824 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 2387
I20260806 02:17:43.503958 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:43.504303 27382 external_mini_cluster.cc:1428] Setting key 038b2b063c87327235724ba704c9acb5
I20260806 02:17:43.504546 2481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:43.512820 2481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52: Bootstrap starting.
I20260806 02:17:43.514668 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:43.505909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42348 (local address 127.26.189.190:38885)
0806 02:17:43.506636 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:43.506651 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:43.506687 (+ 36us) server_negotiation.cc:407] Connection header received
0806 02:17:43.507524 (+ 837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:43.507544 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:43.507960 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:43.508265 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:43.508722 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.509807 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.511122 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.511623 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.511744 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:43.512723 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:43.512728 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:43.512741 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:43.513216 (+ 475us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:43.513275 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:43.513298 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:43.513377 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:43.513609 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 02:17:43.513911 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":178,"threads_started":1}
I20260806 02:17:43.515590 2481 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:43.516595 2481 log.cc:824] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:43.517944 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:17:43.519263 2481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52: No bootstrap required, opened a new log
I20260806 02:17:43.523011 2481 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a0611ab056541bb97d01655576dcd52" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 38885 } }
I20260806 02:17:43.523248 2481 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:43.523340 2481 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0611ab056541bb97d01655576dcd52, State: Initialized, Role: FOLLOWER
I20260806 02:17:43.523834 2481 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a0611ab056541bb97d01655576dcd52" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 38885 } }
I20260806 02:17:43.523963 2481 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:43.524030 2481 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:43.524160 2481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:43.543488 2481 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a0611ab056541bb97d01655576dcd52" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 38885 } }
I20260806 02:17:43.544047 2481 leader_election.cc:302] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a0611ab056541bb97d01655576dcd52; no voters:
I20260806 02:17:43.544492 2481 leader_election.cc:288] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:43.544649 2493 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:43.544902 2493 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [term 1 LEADER]: Becoming Leader. State: Replica: 8a0611ab056541bb97d01655576dcd52, State: Running, Role: LEADER
I20260806 02:17:43.545308 2493 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a0611ab056541bb97d01655576dcd52" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 38885 } }
I20260806 02:17:43.546339 2481 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:43.547186 2495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a0611ab056541bb97d01655576dcd52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a0611ab056541bb97d01655576dcd52" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 38885 } } }
I20260806 02:17:43.547322 2495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:43.547605 2494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a0611ab056541bb97d01655576dcd52. Latest consensus state: current_term: 1 leader_uuid: "8a0611ab056541bb97d01655576dcd52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a0611ab056541bb97d01655576dcd52" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 38885 } } }
I20260806 02:17:43.547794 2494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:43.548290 2499 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:43.551764 2499 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:43.557853 2499 catalog_manager.cc:1347] Generated new cluster ID: 11f30e9b1b16466db29ccabae13203cb
I20260806 02:17:43.557972 2499 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:43.571879 2499 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:43.572944 2499 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:43.588002 2499 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a0611ab056541bb97d01655576dcd52: Generated new TSK 0
I20260806 02:17:43.588927 2499 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 02:17:43.624310 2530 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 02:17:43.624413 2530 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 02:17:43.625125 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:43.608705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42364 (local address 127.26.189.190:38885)
0806 02:17:43.608864 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:43.608869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:43.609078 (+ 209us) server_negotiation.cc:407] Connection header received
0806 02:17:43.609220 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:43.609223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:43.609274 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:43.609373 (+ 99us) server_negotiation.cc:226] Negotiated authn=JWT
0806 02:17:43.609672 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.610247 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.611520 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.611737 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.611816 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:43.612153 (+ 337us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 02:17:43.624757 (+ 12604us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45043/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 02:17:43.625000 (+ 243us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42364: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45043/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 02:17:43.625227 2489 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42364: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45043/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260806 02:17:43.625394 2528 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:17:43.608621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:38885 (local address 127.0.0.1:42364)
0806 02:17:43.608951 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:43.608966 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:43.609090 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:43.609403 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:43.609406 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:43.609414 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0806 02:17:43.609561 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:43.609568 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.610369 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.610372 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:43.611397 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:43.611407 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.611854 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.611858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:43.611950 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:43.611980 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 02:17:43.624985 (+ 13005us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45043/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 02:17:43.625192 (+ 207us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.189.190:38885: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45043/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":123,"threads_started":1}
I20260806 02:17:43.626114 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 2387
2026-08-06T02:17:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (366 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 02:17:43.671557 27382 mini_oidc.cc:152] Starting JWKS server
I20260806 02:17:43.672430 27382 webserver.cc:460] Webserver started at https://127.0.0.1:45297/ using document root <none> and password file <none>
I20260806 02:17:43.672518 27382 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 02:17:43.672719 27382 webserver.cc:460] Webserver started at http://127.0.0.1:39689/ using document root <none> and password file <none>
2026-08-06T02:17:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:43Z Disabled control of system clock
I20260806 02:17:43.683053 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:46611
--webserver_interface=127.26.189.190
--webserver_port=0
--builtin_ntp_servers=127.26.189.148:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:46611
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45297/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 02:17:43.796567 2537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:43.796896 2537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:43.796974 2537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:43.801131 2537 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:43.801246 2537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:43.801277 2537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:43.801316 2537 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:43.801349 2537 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 02:17:43.801385 2537 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 02:17:43.801414 2537 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45297/jwks.json
I20260806 02:17:43.806360 2537 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:46611
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:46611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45297/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:43.807608 2537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:43.809145 2537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:43.818532 2546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:43.818637 2551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:43.818576 2544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:43.818698 2537 server_base.cc:1034] running on GCE node
I20260806 02:17:43.819289 2537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:43.820539 2537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:43.821702 2537 hybrid_clock.cc:648] HybridClock initialized: now 1785982663821680 us; error 35 us; skew 500 ppm
I20260806 02:17:43.823702 2537 webserver.cc:460] Webserver started at http://127.26.189.190:35571/ using document root <none> and password file <none>
I20260806 02:17:43.824390 2537 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:43.824479 2537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:43.824733 2537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:43.826980 2537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "13c438e9a4d44f80b9fe43b1a60d4f91"
format_stamp: "Formatted at 2026-08-06 02:17:43 on dist-test-slave-gkw7"
server_key: "83bb15070e57bd02ec13666584f05035"
server_key_iv: "4fe49f65008af302cf7ce9067776930d"
server_key_version: "encryptionkey@0"
I20260806 02:17:43.827560 2537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "13c438e9a4d44f80b9fe43b1a60d4f91"
format_stamp: "Formatted at 2026-08-06 02:17:43 on dist-test-slave-gkw7"
server_key: "83bb15070e57bd02ec13666584f05035"
server_key_iv: "4fe49f65008af302cf7ce9067776930d"
server_key_version: "encryptionkey@0"
I20260806 02:17:43.831629 2537 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:43.834263 2559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:43.835556 2537 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:17:43.835698 2537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "13c438e9a4d44f80b9fe43b1a60d4f91"
format_stamp: "Formatted at 2026-08-06 02:17:43 on dist-test-slave-gkw7"
server_key: "83bb15070e57bd02ec13666584f05035"
server_key_iv: "4fe49f65008af302cf7ce9067776930d"
server_key_version: "encryptionkey@0"
I20260806 02:17:43.835829 2537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:43.851387 2537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:43.852124 2537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:43.852360 2537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:43.860044 2537 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:46611
I20260806 02:17:43.860077 2637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:46611 every 8 connection(s)
I20260806 02:17:43.861088 2537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:43.864511 2638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:43.869576 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 2537
I20260806 02:17:43.869731 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:43.870031 27382 external_mini_cluster.cc:1428] Setting key a9913f2d247d9728c6394c4faeda7a1f
I20260806 02:17:43.870544 2638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91: Bootstrap starting.
I20260806 02:17:43.873345 2638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:43.874290 2638 log.cc:824] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:43.876704 2638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91: No bootstrap required, opened a new log
I20260806 02:17:43.881628 2642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:43.871673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48842 (local address 127.26.189.190:46611)
0806 02:17:43.872423 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:43.872442 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:43.872485 (+ 43us) server_negotiation.cc:407] Connection header received
0806 02:17:43.873371 (+ 886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:43.873397 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:43.873968 (+ 571us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:43.874354 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:43.874979 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.876489 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.877491 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.878210 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.878375 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:43.879311 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:43.879318 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:43.879335 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:43.879854 (+ 519us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:43.879924 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:43.879952 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:43.880064 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:43.880245 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 02:17:43.880599 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":128,"threads_started":1}
I20260806 02:17:43.881487 2638 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c438e9a4d44f80b9fe43b1a60d4f91" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46611 } }
I20260806 02:17:43.881812 2638 raft_consensus.cc:374] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:43.881871 2638 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13c438e9a4d44f80b9fe43b1a60d4f91, State: Initialized, Role: FOLLOWER
I20260806 02:17:43.882277 2638 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c438e9a4d44f80b9fe43b1a60d4f91" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46611 } }
I20260806 02:17:43.882386 2638 raft_consensus.cc:388] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:43.882423 2638 raft_consensus.cc:482] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:43.882486 2638 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:43.884735 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:17:43.940372 2638 raft_consensus.cc:504] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c438e9a4d44f80b9fe43b1a60d4f91" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46611 } }
I20260806 02:17:43.940994 2638 leader_election.cc:302] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13c438e9a4d44f80b9fe43b1a60d4f91; no voters:
I20260806 02:17:43.941512 2638 leader_election.cc:288] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:43.941748 2644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:43.942050 2644 raft_consensus.cc:686] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [term 1 LEADER]: Becoming Leader. State: Replica: 13c438e9a4d44f80b9fe43b1a60d4f91, State: Running, Role: LEADER
I20260806 02:17:43.942436 2644 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c438e9a4d44f80b9fe43b1a60d4f91" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46611 } }
I20260806 02:17:43.943281 2638 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:43.944377 2645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13c438e9a4d44f80b9fe43b1a60d4f91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c438e9a4d44f80b9fe43b1a60d4f91" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46611 } } }
I20260806 02:17:43.944535 2645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:43.944976 2646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13c438e9a4d44f80b9fe43b1a60d4f91. Latest consensus state: current_term: 1 leader_uuid: "13c438e9a4d44f80b9fe43b1a60d4f91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c438e9a4d44f80b9fe43b1a60d4f91" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46611 } } }
I20260806 02:17:43.945153 2646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:43.946130 2655 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:43.949836 2655 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:43.956120 2655 catalog_manager.cc:1347] Generated new cluster ID: 7a1e7a0b3cd947fc85c9b65cc856937c
I20260806 02:17:43.956233 2655 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:43.972503 2655 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:43.973757 2655 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:43.982506 2655 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 13c438e9a4d44f80b9fe43b1a60d4f91: Generated new TSK 0
I20260806 02:17:43.983332 2655 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:17:44.002627 2642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:43.997030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48858 (local address 127.26.189.190:46611)
0806 02:17:43.997194 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:43.997202 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:43.997361 (+ 159us) server_negotiation.cc:407] Connection header received
0806 02:17:43.997653 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:43.997656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:43.997709 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:43.997813 (+ 104us) server_negotiation.cc:226] Negotiated authn=JWT
0806 02:17:43.998114 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.998700 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:44.000077 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:44.000308 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:44.000395 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:44.000781 (+ 386us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 02:17:44.002175 (+ 1394us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45297/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 02:17:44.002453 (+ 278us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48858: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45297/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 02:17:44.002663 2672 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:17:43.996912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:46611 (local address 127.0.0.1:48858)
0806 02:17:43.997256 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:43.997273 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:43.997403 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:43.997839 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:43.997843 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:43.997852 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0806 02:17:43.997981 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:43.997988 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:43.998818 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:43.998822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:43.999951 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:43.999961 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:44.000448 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:44.000453 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:44.000556 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:44.000596 (+ 40us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 02:17:44.002344 (+ 1748us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45297/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 02:17:44.002495 (+ 151us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.189.190:46611: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45297/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":140,"threads_started":1}
W20260806 02:17:44.002722 2642 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48858: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45297/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260806 02:17:44.003378 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 2537
E20260806 02:17:44.022217 2673 webserver.cc:533] Webserver: sslize failed:
E20260806 02:17:44.022307 2673 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-06T02:17:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (380 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T02:17:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:44Z Disabled control of system clock
I20260806 02:17:44.063616 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:44007
--webserver_interface=127.26.189.190
--webserver_port=0
--builtin_ntp_servers=127.26.189.148:39491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:44007
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/testchainca.cert with env {}
W20260806 02:17:44.179555 2679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:44.179913 2679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:44.180006 2679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:44.184175 2679 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:44.184280 2679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:44.184311 2679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:44.184355 2679 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:44.184388 2679 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 02:17:44.184420 2679 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 02:17:44.184450 2679 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 02:17:44.190213 2679 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:44007
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:44007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:44.191407 2679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:44.192490 2679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:44.201591 2687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:44.201537 2689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:44.201572 2686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:44.201972 2679 server_base.cc:1034] running on GCE node
I20260806 02:17:44.202850 2679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:44.203991 2679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:44.205183 2679 hybrid_clock.cc:648] HybridClock initialized: now 1785982664205144 us; error 52 us; skew 500 ppm
I20260806 02:17:44.210945 2679 webserver.cc:460] Webserver started at http://127.26.189.190:42105/ using document root <none> and password file <none>
I20260806 02:17:44.211655 2679 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:44.211735 2679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:44.211974 2679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:44.214366 2679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "e1090744704741ae9f2822278225a8a7"
format_stamp: "Formatted at 2026-08-06 02:17:44 on dist-test-slave-gkw7"
server_key: "739b1e50e7752c82e118e7829ba7fe01"
server_key_iv: "98042faf54bc5a823df6a7a93246255a"
server_key_version: "encryptionkey@0"
I20260806 02:17:44.214998 2679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "e1090744704741ae9f2822278225a8a7"
format_stamp: "Formatted at 2026-08-06 02:17:44 on dist-test-slave-gkw7"
server_key: "739b1e50e7752c82e118e7829ba7fe01"
server_key_iv: "98042faf54bc5a823df6a7a93246255a"
server_key_version: "encryptionkey@0"
I20260806 02:17:44.219370 2679 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 02:17:44.222061 2701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:44.223491 2679 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:44.223646 2679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "e1090744704741ae9f2822278225a8a7"
format_stamp: "Formatted at 2026-08-06 02:17:44 on dist-test-slave-gkw7"
server_key: "739b1e50e7752c82e118e7829ba7fe01"
server_key_iv: "98042faf54bc5a823df6a7a93246255a"
server_key_version: "encryptionkey@0"
I20260806 02:17:44.223766 2679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:44.242043 2679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:44.242826 2679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:44.243052 2679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:44.250634 2679 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:44007
I20260806 02:17:44.250656 2771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:44007 every 8 connection(s)
I20260806 02:17:44.251658 2679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:44.254892 2772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:44.260746 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 2679
I20260806 02:17:44.260861 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:44.261087 2772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7: Bootstrap starting.
I20260806 02:17:44.261157 27382 external_mini_cluster.cc:1428] Setting key 59b1347acd5f06a8cb32cda8b18dd42b
I20260806 02:17:44.263902 2772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:44.264833 2772 log.cc:824] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:44.267285 2772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7: No bootstrap required, opened a new log
I20260806 02:17:44.271437 2775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:44.262658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45560 (local address 127.26.189.190:44007)
0806 02:17:44.263334 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:44.263349 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:44.263385 (+ 36us) server_negotiation.cc:407] Connection header received
0806 02:17:44.264125 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:44.264155 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:44.264569 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:44.264869 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:44.265315 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:44.266489 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:44.267815 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:44.268282 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:44.268403 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:44.269461 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:44.269467 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:44.269481 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:17:44.269963 (+ 482us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:44.270022 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:17:44.270044 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:44.270125 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:44.270310 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 02:17:44.270624 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":159,"threads_started":1}
I20260806 02:17:44.272156 2772 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1090744704741ae9f2822278225a8a7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44007 } }
I20260806 02:17:44.272524 2772 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:44.272603 2772 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1090744704741ae9f2822278225a8a7, State: Initialized, Role: FOLLOWER
I20260806 02:17:44.273161 2772 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1090744704741ae9f2822278225a8a7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44007 } }
I20260806 02:17:44.273372 2772 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:44.273447 2772 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:44.273592 2772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:44.275071 2772 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1090744704741ae9f2822278225a8a7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44007 } }
I20260806 02:17:44.275409 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:17:44.275506 2772 leader_election.cc:302] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1090744704741ae9f2822278225a8a7; no voters:
I20260806 02:17:44.275921 2772 leader_election.cc:288] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:44.276057 2781 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:44.276286 2781 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [term 1 LEADER]: Becoming Leader. State: Replica: e1090744704741ae9f2822278225a8a7, State: Running, Role: LEADER
I20260806 02:17:44.276635 2781 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1090744704741ae9f2822278225a8a7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44007 } }
I20260806 02:17:44.277488 2772 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:44.278584 2782 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1090744704741ae9f2822278225a8a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1090744704741ae9f2822278225a8a7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44007 } } }
I20260806 02:17:44.278584 2786 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1090744704741ae9f2822278225a8a7. Latest consensus state: current_term: 1 leader_uuid: "e1090744704741ae9f2822278225a8a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1090744704741ae9f2822278225a8a7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44007 } } }
I20260806 02:17:44.278754 2786 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:44.278754 2782 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:44.279142 2800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:44.282047 2800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:44.288465 2800 catalog_manager.cc:1347] Generated new cluster ID: 3e2930543f0444a887be7cda0e3e879c
I20260806 02:17:44.288546 2800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:44.303191 2800 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:44.304148 2800 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:44.310582 2800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1090744704741ae9f2822278225a8a7: Generated new TSK 0
I20260806 02:17:44.311522 2800 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:17:44.395531 2775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:44.326451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45568 (local address 127.26.189.190:44007)
0806 02:17:44.326602 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:44.326609 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:44.326810 (+ 201us) server_negotiation.cc:407] Connection header received
0806 02:17:44.326986 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:44.326988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:44.327035 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:44.327127 (+ 92us) server_negotiation.cc:226] Negotiated authn=JWT
0806 02:17:44.327400 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:44.328077 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:44.329476 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:44.329765 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:44.329847 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:44.330236 (+ 389us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 02:17:44.394977 (+ 64741us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 02:17:44.395311 (+ 334us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45568: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":61}
W20260806 02:17:44.395632 2775 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45568: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260806 02:17:44.395779 2816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:17:44.326368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:44007 (local address 127.0.0.1:45568)
0806 02:17:44.326706 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:44.326722 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:44.326855 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:44.327159 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:44.327163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:44.327172 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0806 02:17:44.327295 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:44.327302 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:44.328198 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:44.328203 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:44.329353 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:44.329365 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:44.329911 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:44.329916 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:44.330023 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:44.330055 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 02:17:44.395253 (+ 65198us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 02:17:44.395574 (+ 321us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.189.190:44007: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":113,"threads_started":1}
I20260806 02:17:44.396548 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 2679
2026-08-06T02:17:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (372 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (130 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (130 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:44 dist-test-slave-gkw7 krb5kdc[2834](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:44 dist-test-slave-gkw7 krb5kdc[2834](info): set up 2 sockets
Aug 06 02:17:44 dist-test-slave-gkw7 krb5kdc[2834](info): commencing operation
krb5kdc: starting...
W20260806 02:17:45.916380 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:46 dist-test-slave-gkw7 krb5kdc[2834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:17:46.058236 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:35469
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:35469
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:46.174012 2850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:46.174377 2850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:46.174456 2850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:46.178586 2850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:46.178702 2850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:46.178745 2850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:46.178784 2850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:46.178815 2850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:46.184262 2850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:35469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:35469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:46.185436 2850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:46.186609 2850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:46.195698 2856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:46.195713 2855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:46.195757 2850 server_base.cc:1034] running on GCE node
W20260806 02:17:46.195941 2861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:46.196651 2850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:46.197932 2850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:46.199127 2850 hybrid_clock.cc:648] HybridClock initialized: now 1785982666199095 us; error 46 us; skew 500 ppm
Aug 06 02:17:46 dist-test-slave-gkw7 krb5kdc[2834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982666, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:46.202132 2850 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:17:46.203048 2850 webserver.cc:460] Webserver started at http://127.26.189.190:37349/ using document root <none> and password file <none>
I20260806 02:17:46.203629 2850 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:46.203693 2850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:46.203938 2850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:46.206202 2850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "d2f003ed8c414806b9c1704c6d7a942e"
format_stamp: "Formatted at 2026-08-06 02:17:46 on dist-test-slave-gkw7"
server_key: "10d9e3e88e0a6604b2abe8fbdf5fef92"
server_key_iv: "e3e6c3d58c6c60141e0eff4213822ede"
server_key_version: "encryptionkey@0"
I20260806 02:17:46.206796 2850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "d2f003ed8c414806b9c1704c6d7a942e"
format_stamp: "Formatted at 2026-08-06 02:17:46 on dist-test-slave-gkw7"
server_key: "10d9e3e88e0a6604b2abe8fbdf5fef92"
server_key_iv: "e3e6c3d58c6c60141e0eff4213822ede"
server_key_version: "encryptionkey@0"
I20260806 02:17:46.210584 2850 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:46.213111 2872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:46.214419 2850 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:17:46.214576 2850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "d2f003ed8c414806b9c1704c6d7a942e"
format_stamp: "Formatted at 2026-08-06 02:17:46 on dist-test-slave-gkw7"
server_key: "10d9e3e88e0a6604b2abe8fbdf5fef92"
server_key_iv: "e3e6c3d58c6c60141e0eff4213822ede"
server_key_version: "encryptionkey@0"
I20260806 02:17:46.214705 2850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:46.235383 2850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:46.238849 2850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:46.239089 2850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:46.246897 2850 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:35469
I20260806 02:17:46.246927 2946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:35469 every 8 connection(s)
I20260806 02:17:46.247890 2850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:46.250792 2947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:46.256301 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 2850
I20260806 02:17:46.256419 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:46.256531 2947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e: Bootstrap starting.
I20260806 02:17:46.256799 27382 external_mini_cluster.cc:1428] Setting key 3af3c9c2a4204c2e9881c2d1f575c5b8
I20260806 02:17:46.259372 2947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:46.260321 2947 log.cc:824] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:46.262699 2947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e: No bootstrap required, opened a new log
I20260806 02:17:46.266949 2947 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2f003ed8c414806b9c1704c6d7a942e" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35469 } }
Aug 06 02:17:46 dist-test-slave-gkw7 krb5kdc[2834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:46.267261 2947 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:46.267328 2947 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2f003ed8c414806b9c1704c6d7a942e, State: Initialized, Role: FOLLOWER
I20260806 02:17:46.267866 2947 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2f003ed8c414806b9c1704c6d7a942e" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35469 } }
I20260806 02:17:46.268009 2947 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:46.268090 2947 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:46.268190 2947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:46.269220 2947 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2f003ed8c414806b9c1704c6d7a942e" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35469 } }
I20260806 02:17:46.269634 2947 leader_election.cc:302] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2f003ed8c414806b9c1704c6d7a942e; no voters:
I20260806 02:17:46.269997 2947 leader_election.cc:288] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:46.270076 2953 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:46.270295 2953 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [term 1 LEADER]: Becoming Leader. State: Replica: d2f003ed8c414806b9c1704c6d7a942e, State: Running, Role: LEADER
I20260806 02:17:46.270607 2953 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2f003ed8c414806b9c1704c6d7a942e" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35469 } }
I20260806 02:17:46.271379 2947 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:46.272472 2954 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2f003ed8c414806b9c1704c6d7a942e. Latest consensus state: current_term: 1 leader_uuid: "d2f003ed8c414806b9c1704c6d7a942e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2f003ed8c414806b9c1704c6d7a942e" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35469 } } }
I20260806 02:17:46.272599 2954 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:46.272895 2956 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2f003ed8c414806b9c1704c6d7a942e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2f003ed8c414806b9c1704c6d7a942e" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35469 } } }
I20260806 02:17:46.273012 2956 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:46.273254 2960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:46.274488 2951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:46.258425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58754 (local address 127.26.189.190:35469)
0806 02:17:46.258907 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:46.258927 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:46.258971 (+ 44us) server_negotiation.cc:407] Connection header received
0806 02:17:46.259930 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:46.259955 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:46.260395 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:46.260795 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:46.261758 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:46.263234 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:46.264131 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:46.264839 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:46.265016 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:46.267910 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:46.267915 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:46.267928 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:46.267958 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:46.270302 (+ 2344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:46.270879 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:46.270885 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:46.270891 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:46.271023 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:46.271487 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:46.271494 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:46.271497 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:46.272090 (+ 593us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:46.272947 (+ 857us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:46.273109 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 02:17:46.273426 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":138,"threads_started":1}
I20260806 02:17:46.277029 2960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:46.284327 2960 catalog_manager.cc:1347] Generated new cluster ID: fdcaed77b8a04790ad619a4d9fdb7766
I20260806 02:17:46.284412 2960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:46.296269 2960 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:46.297307 2960 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:46.308377 2960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2f003ed8c414806b9c1704c6d7a942e: Generated new TSK 0
I20260806 02:17:46.309183 2960 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:17:46.349830 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:35469
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:46.497864 2983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:46.498188 2983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:46.498281 2983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:46.502471 2983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:46.502576 2983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:46.502676 2983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:46.508220 2983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:35469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:46.509392 2983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:46.510542 2983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:46.520749 2991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:46.520875 2983 server_base.cc:1034] running on GCE node
W20260806 02:17:46.520743 2988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:46.520756 2989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:46.521664 2983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:46.522383 2983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:46.523564 2983 hybrid_clock.cc:648] HybridClock initialized: now 1785982666523558 us; error 55 us; skew 500 ppm
Aug 06 02:17:46 dist-test-slave-gkw7 krb5kdc[2834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982666, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:46.526616 2983 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:17:46.527550 2983 webserver.cc:460] Webserver started at http://127.26.189.129:36643/ using document root <none> and password file <none>
I20260806 02:17:46.528164 2983 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:46.528260 2983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:46.528515 2983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:46.530764 2983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "38fe0fd049ce4140ac77e359d8eb2245"
format_stamp: "Formatted at 2026-08-06 02:17:46 on dist-test-slave-gkw7"
server_key: "561209b928ff378ccd0a5c1a61f0408f"
server_key_iv: "dde3ba5126bbcf73f5a9c8f52b458882"
server_key_version: "encryptionkey@0"
I20260806 02:17:46.531354 2983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "38fe0fd049ce4140ac77e359d8eb2245"
format_stamp: "Formatted at 2026-08-06 02:17:46 on dist-test-slave-gkw7"
server_key: "561209b928ff378ccd0a5c1a61f0408f"
server_key_iv: "dde3ba5126bbcf73f5a9c8f52b458882"
server_key_version: "encryptionkey@0"
I20260806 02:17:46.535422 2983 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:46.538103 3002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:46.539391 2983 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:46.539535 2983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "38fe0fd049ce4140ac77e359d8eb2245"
format_stamp: "Formatted at 2026-08-06 02:17:46 on dist-test-slave-gkw7"
server_key: "561209b928ff378ccd0a5c1a61f0408f"
server_key_iv: "dde3ba5126bbcf73f5a9c8f52b458882"
server_key_version: "encryptionkey@0"
I20260806 02:17:46.539671 2983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:46.573079 2983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:46.576778 2983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:46.577032 2983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:46.577783 2983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:46.578727 2983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:46.578806 2983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:46.578886 2983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:46.578943 2983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:46.588773 2983 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:40707
I20260806 02:17:46.588802 3166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:40707 every 8 connection(s)
I20260806 02:17:46.589829 2983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:46.599514 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 2983
I20260806 02:17:46.599671 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:17:46.600018 27382 external_mini_cluster.cc:1428] Setting key 7c38239302d51da6e72076304bda6aa5
Aug 06 02:17:46 dist-test-slave-gkw7 krb5kdc[2834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982666, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:46.605491 2951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:46.591889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:52997 (local address 127.26.189.190:35469)
0806 02:17:46.592033 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:46.592037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:46.592985 (+ 948us) server_negotiation.cc:407] Connection header received
0806 02:17:46.594512 (+ 1527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:46.594516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:46.594575 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:46.594687 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:46.595902 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:46.596460 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:46.597685 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:46.597933 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:46.598059 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:46.600918 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:46.600921 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:46.600924 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:46.600952 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:46.602940 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:46.603577 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:46.603584 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:46.603590 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:46.603702 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:46.604084 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:46.604091 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:46.604093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:46.604380 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:46.604477 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:46.605245 (+ 768us) server_negotiation.cc:299] Negotiation successful
0806 02:17:46.605365 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 02:17:46.606896 3170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:46.592323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:35469 (local address 127.26.189.129:52997)
0806 02:17:46.592817 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:46.592861 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:46.594292 (+ 1431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:46.594867 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:46.594874 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:46.595245 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:46.595741 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:46.595754 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:46.596605 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:46.596609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:46.597495 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:46.597504 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:46.598101 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:46.598106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:46.598281 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:46.598872 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:46.598888 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:46.600710 (+ 1822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:46.603097 (+ 2387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:46.603108 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:46.603126 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:46.603436 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:46.603810 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:46.603813 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:46.603814 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:46.603966 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:46.604514 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:46.604523 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:46.604908 (+ 385us) client_negotiation.cc:769] Sending connection context
0806 02:17:46.605172 (+ 264us) client_negotiation.cc:240] Negotiation successful
0806 02:17:46.605659 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":116,"threads_started":1}
I20260806 02:17:46.608525 3167 heartbeater.cc:347] Connected to a master server at 127.26.189.190:35469
I20260806 02:17:46.608814 3167 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:46.609411 3167 heartbeater.cc:511] Master 127.26.189.190:35469 requested a full tablet report, sending...
I20260806 02:17:46.611419 2897 ts_manager.cc:194] Registered new tserver with Master: 38fe0fd049ce4140ac77e359d8eb2245 (127.26.189.129:40707)
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
I20260806 02:17:46.613320 2897 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:52997
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:17:46.637398 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:35469
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:46.751996 3174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:46.752269 3174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:46.752314 3174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:46.756685 3174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:46.756762 3174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:46.756820 3174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:46.762109 3174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:35469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:46.763126 3174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:46.764137 3174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:46.774113 3190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:46.774154 3188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:46.774175 3185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:46.774557 3174 server_base.cc:1034] running on GCE node
I20260806 02:17:46.774952 3174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:46.775620 3174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:46.776842 3174 hybrid_clock.cc:648] HybridClock initialized: now 1785982666776793 us; error 65 us; skew 500 ppm
Aug 06 02:17:46 dist-test-slave-gkw7 krb5kdc[2834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982666, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:46.780290 3174 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:17:46.781265 3174 webserver.cc:460] Webserver started at http://127.26.189.130:45809/ using document root <none> and password file <none>
I20260806 02:17:46.781975 3174 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:46.782094 3174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:46.782387 3174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:46.784643 3174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "b98a9c6be5d6489aa68c935a65d3c8a0"
format_stamp: "Formatted at 2026-08-06 02:17:46 on dist-test-slave-gkw7"
server_key: "af6baae3b9e75b0ba9a9a2c98ba2a2ed"
server_key_iv: "9e850b7a802ab5d6ff1c12a6754b734d"
server_key_version: "encryptionkey@0"
I20260806 02:17:46.785305 3174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "b98a9c6be5d6489aa68c935a65d3c8a0"
format_stamp: "Formatted at 2026-08-06 02:17:46 on dist-test-slave-gkw7"
server_key: "af6baae3b9e75b0ba9a9a2c98ba2a2ed"
server_key_iv: "9e850b7a802ab5d6ff1c12a6754b734d"
server_key_version: "encryptionkey@0"
I20260806 02:17:46.789736 3174 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 02:17:46.792426 3198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:46.793907 3174 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:46.794037 3174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "b98a9c6be5d6489aa68c935a65d3c8a0"
format_stamp: "Formatted at 2026-08-06 02:17:46 on dist-test-slave-gkw7"
server_key: "af6baae3b9e75b0ba9a9a2c98ba2a2ed"
server_key_iv: "9e850b7a802ab5d6ff1c12a6754b734d"
server_key_version: "encryptionkey@0"
I20260806 02:17:46.794171 3174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:46.809285 3174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:46.813062 3174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:46.813304 3174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:46.814028 3174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:46.814965 3174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:46.815018 3174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:46.815099 3174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:46.815140 3174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:46.825508 3174 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:43853
I20260806 02:17:46.825574 3368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:43853 every 8 connection(s)
I20260806 02:17:46.826519 3174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:46.835343 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 3174
I20260806 02:17:46.835474 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:17:46.835804 27382 external_mini_cluster.cc:1428] Setting key 854180c993cd7121838388e3a18888c7
Aug 06 02:17:46 dist-test-slave-gkw7 krb5kdc[2834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982666, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:46.841889 2951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:46.828458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:45101 (local address 127.26.189.190:35469)
0806 02:17:46.828609 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:46.828612 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:46.829445 (+ 833us) server_negotiation.cc:407] Connection header received
0806 02:17:46.830963 (+ 1518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:46.830967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:46.831031 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:46.831139 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:46.832375 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:46.832909 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:46.834073 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:46.834306 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:46.834397 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:46.837503 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:46.837507 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:46.837510 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:46.837568 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:46.839245 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:46.839969 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:46.839976 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:46.839979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:46.840099 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:46.840469 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:46.840474 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:46.840476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:46.840753 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:46.840881 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:46.841641 (+ 760us) server_negotiation.cc:299] Negotiation successful
0806 02:17:46.841751 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 02:17:46.843348 3372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:46.828758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:35469 (local address 127.26.189.130:45101)
0806 02:17:46.829257 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:46.829307 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:46.830715 (+ 1408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:46.831307 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:46.831313 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:46.831673 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:46.832205 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:46.832219 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:46.833025 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:46.833027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:46.833946 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:46.833955 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:46.834454 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:46.834457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:46.834595 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:46.835202 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:46.835226 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:46.837304 (+ 2078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:46.839384 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:46.839394 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:46.839415 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:46.839852 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:46.840208 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:46.840210 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:46.840212 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:46.840364 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:46.840908 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:46.840914 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:46.841263 (+ 349us) client_negotiation.cc:769] Sending connection context
0806 02:17:46.841517 (+ 254us) client_negotiation.cc:240] Negotiation successful
0806 02:17:46.842003 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":123,"threads_started":1}
I20260806 02:17:46.844735 3370 heartbeater.cc:347] Connected to a master server at 127.26.189.190:35469
I20260806 02:17:46.845044 3370 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:46.845820 3370 heartbeater.cc:511] Master 127.26.189.190:35469 requested a full tablet report, sending...
I20260806 02:17:46.847113 2897 ts_manager.cc:194] Registered new tserver with Master: b98a9c6be5d6489aa68c935a65d3c8a0 (127.26.189.130:43853)
I20260806 02:17:46.847761 2897 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:45101
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:17:46.869944 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:35469
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:46.992513 3376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:46.992796 3376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:46.992877 3376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:46.997129 3376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:46.997258 3376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:46.997367 3376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:47.003281 3376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:35469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:47.004549 3376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:47.005764 3376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:47.016109 3391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:47.016253 3388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:47.016109 3384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:47.016424 3376 server_base.cc:1034] running on GCE node
I20260806 02:17:47.016988 3376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:47.017831 3376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:47.019032 3376 hybrid_clock.cc:648] HybridClock initialized: now 1785982667018997 us; error 51 us; skew 500 ppm
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[2834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982667, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:47.022286 3376 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:17:47.023388 3376 webserver.cc:460] Webserver started at http://127.26.189.131:42975/ using document root <none> and password file <none>
I20260806 02:17:47.023988 3376 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:47.024093 3376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:47.024318 3376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:47.026530 3376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "e14261e0bb174aabb79a54d029bdb50e"
format_stamp: "Formatted at 2026-08-06 02:17:47 on dist-test-slave-gkw7"
server_key: "1f80482ae0fccc59580482fa00b53810"
server_key_iv: "07e06cae74641be9c1ce441716739f52"
server_key_version: "encryptionkey@0"
I20260806 02:17:47.027148 3376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "e14261e0bb174aabb79a54d029bdb50e"
format_stamp: "Formatted at 2026-08-06 02:17:47 on dist-test-slave-gkw7"
server_key: "1f80482ae0fccc59580482fa00b53810"
server_key_iv: "07e06cae74641be9c1ce441716739f52"
server_key_version: "encryptionkey@0"
I20260806 02:17:47.031095 3376 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:47.033866 3401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:47.035271 3376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:47.035449 3376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "e14261e0bb174aabb79a54d029bdb50e"
format_stamp: "Formatted at 2026-08-06 02:17:47 on dist-test-slave-gkw7"
server_key: "1f80482ae0fccc59580482fa00b53810"
server_key_iv: "07e06cae74641be9c1ce441716739f52"
server_key_version: "encryptionkey@0"
I20260806 02:17:47.035591 3376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:47.053694 3376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:47.057075 3376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:47.057322 3376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:47.058058 3376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:47.058959 3376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:47.059038 3376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:47.059113 3376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:47.059159 3376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:47.069059 3376 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:35509
I20260806 02:17:47.069119 3575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:35509 every 8 connection(s)
I20260806 02:17:47.070155 3376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:47.078552 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 3376
I20260806 02:17:47.078730 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:17:47.079048 27382 external_mini_cluster.cc:1428] Setting key 35aa6200cad6e673722ea8d02a9f123a
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[2834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982667, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:17:47.085675 2951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:47.072276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:33689 (local address 127.26.189.190:35469)
0806 02:17:47.072479 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:47.072484 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:47.073420 (+ 936us) server_negotiation.cc:407] Connection header received
0806 02:17:47.075081 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:47.075085 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:47.075150 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:47.075268 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:47.076566 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:47.077115 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:47.078492 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:47.078799 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:47.078927 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:47.081979 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:47.081982 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:47.081984 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:47.082010 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:47.083471 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:47.084007 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:47.084010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:47.084012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:47.084147 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:47.084503 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:47.084505 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:47.084506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:47.084707 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:47.084792 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:47.085312 (+ 520us) server_negotiation.cc:299] Negotiation successful
0806 02:17:47.085439 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 02:17:47.086481 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:47.072731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:35469 (local address 127.26.189.131:33689)
0806 02:17:47.073255 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:47.073300 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:47.074838 (+ 1538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:47.075457 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:47.075464 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:47.075867 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:47.076381 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:47.076395 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:47.077268 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:47.077272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:47.078349 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:47.078361 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:47.078984 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:47.078988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:47.079192 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:47.079848 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:47.079868 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:47.081819 (+ 1951us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:47.083598 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:47.083603 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:47.083618 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:47.083874 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:47.084249 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:47.084252 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:47.084254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:47.084404 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:47.084801 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:47.084806 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:47.085049 (+ 243us) client_negotiation.cc:769] Sending connection context
0806 02:17:47.085215 (+ 166us) client_negotiation.cc:240] Negotiation successful
0806 02:17:47.085481 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":118,"threads_started":1}
I20260806 02:17:47.087752 3576 heartbeater.cc:347] Connected to a master server at 127.26.189.190:35469
I20260806 02:17:47.088040 3576 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:47.088595 3576 heartbeater.cc:511] Master 127.26.189.190:35469 requested a full tablet report, sending...
I20260806 02:17:47.089742 2897 ts_manager.cc:194] Registered new tserver with Master: e14261e0bb174aabb79a54d029bdb50e (127.26.189.131:35509)
I20260806 02:17:47.090337 2897 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:33689
I20260806 02:17:47.093746 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/test-admin.keytab.
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[2834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:47.115016 27382 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 02:17:47.118238 3585 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:17:47.116632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41254 (local address 127.26.189.129:40707)
0806 02:17:47.117012 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:47.117018 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:47.117041 (+ 23us) server_negotiation.cc:407] Connection header received
0806 02:17:47.117092 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:47.117097 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:47.117302 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:47.117470 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:47.118028 (+ 558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41254: BlockingRecv error: recv got EOF from 127.0.0.1:41254 (error 108)
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":122,"threads_started":1}
W20260806 02:17:47.118419 27382 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/krb5cc' of type FILE
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[2834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:47.119633 27382 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[2834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:47.120678 27382 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[2834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.129@KRBTEST.COM
I20260806 02:17:47.131619 3585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:47.121658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41256 (local address 127.26.189.129:40707)
0806 02:17:47.121827 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:47.121832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:47.121885 (+ 53us) server_negotiation.cc:407] Connection header received
0806 02:17:47.121989 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:47.121991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:47.122039 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:47.122122 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:47.122682 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:47.123691 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:47.124547 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:47.124980 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:47.125074 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:47.127683 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:47.127694 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:47.127711 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:47.127738 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:47.129845 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:47.130277 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:47.130282 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:47.130284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:47.130369 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:47.130630 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:47.130632 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:47.130633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:47.130892 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:47.131077 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:47.131229 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 02:17:47.131428 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260806 02:17:47.135847 3585 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:17:47.134772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41264 (local address 127.26.189.129:40707)
0806 02:17:47.134914 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:47.134919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:47.135031 (+ 112us) server_negotiation.cc:407] Connection header received
0806 02:17:47.135174 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:47.135178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:47.135231 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:47.135322 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:47.135732 (+ 410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41264: BlockingRecv error: recv got EOF from 127.0.0.1:41264 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260806 02:17:47.136186 27382 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/krb5cc)
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[2834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:47.137307 27382 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[2834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:47.138298 27382 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[2834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.129@KRBTEST.COM
I20260806 02:17:47.147375 3585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:47.139183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41278 (local address 127.26.189.129:40707)
0806 02:17:47.139309 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:47.139313 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:47.139414 (+ 101us) server_negotiation.cc:407] Connection header received
0806 02:17:47.139562 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:47.139565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:47.139605 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:47.139721 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:47.140251 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:47.140762 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:47.141615 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:47.141861 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:47.141978 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:47.144146 (+ 2168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:47.144149 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:47.144152 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:47.144179 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:47.145719 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:47.146163 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:47.146167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:47.146168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:47.146257 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:47.146533 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:47.146538 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:47.146539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:47.146711 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:47.146870 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:47.147094 (+ 224us) server_negotiation.cc:299] Negotiation successful
0806 02:17:47.147223 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260806 02:17:47.150223 3585 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:17:47.149044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41292 (local address 127.26.189.129:40707)
0806 02:17:47.149171 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:47.149175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:47.149261 (+ 86us) server_negotiation.cc:407] Connection header received
0806 02:17:47.149402 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:47.149405 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:47.149442 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:47.149538 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:47.150073 (+ 535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41292: BlockingRecv error: recv got EOF from 127.0.0.1:41292 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 02:17:47.150465 27382 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785982634882397-27382-0/krb5kdc/krb5cc' of type FILE
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[2834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:47.151590 27382 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[2834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:47.152595 27382 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[2834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.129@KRBTEST.COM
I20260806 02:17:47.161367 3585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:47.153402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41298 (local address 127.26.189.129:40707)
0806 02:17:47.153592 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:47.153609 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:47.153664 (+ 55us) server_negotiation.cc:407] Connection header received
0806 02:17:47.153760 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:47.153763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:47.153802 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:47.153876 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:47.154361 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:47.154875 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:47.155643 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:47.155879 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:47.155975 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:47.158209 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:47.158212 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:47.158214 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:47.158235 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:47.159723 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:47.160172 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:47.160175 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:47.160176 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:47.160271 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:47.160521 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:47.160524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:47.160525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:47.160702 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:47.160831 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:47.160975 (+ 144us) server_negotiation.cc:299] Negotiation successful
0806 02:17:47.161157 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 02:17:47.162673 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 2983
I20260806 02:17:47.173688 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 3174
I20260806 02:17:47.186589 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 3376
I20260806 02:17:47.203100 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 2850
2026-08-06T02:17:47Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2544 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[3602](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[3602](info): set up 2 sockets
Aug 06 02:17:47 dist-test-slave-gkw7 krb5kdc[3602](info): commencing operation
krb5kdc: starting...
W20260806 02:17:48.530725 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.299s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:48 dist-test-slave-gkw7 krb5kdc[3602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:48Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.190.keytab.
Entry for principal oryx/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.190.keytab.
I20260806 02:17:48.668602 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:40257
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.190.keytab
--principal=oryx/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:44885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:40257
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:48.782835 3617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:48.783159 3617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:48.783259 3617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:48.787243 3617 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:48.787343 3617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:48.787384 3617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:48.787423 3617 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:48.787454 3617 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:48.792663 3617 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:44885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:40257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.190.keytab
--principal=oryx/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:40257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:48.793757 3617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:48.794797 3617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:48.803676 3623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:48.803710 3624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:48.803730 3628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:48.803866 3617 server_base.cc:1034] running on GCE node
I20260806 02:17:48.804582 3617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:48.805697 3617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:48.806911 3617 hybrid_clock.cc:648] HybridClock initialized: now 1785982668806890 us; error 33 us; skew 500 ppm
Aug 06 02:17:48 dist-test-slave-gkw7 krb5kdc[3602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982668, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:48.809906 3617 init.cc:377] Logged in from keytab as oryx/127.26.189.190@KRBTEST.COM (short username oryx)
I20260806 02:17:48.810897 3617 webserver.cc:460] Webserver started at http://127.26.189.190:40431/ using document root <none> and password file <none>
I20260806 02:17:48.811508 3617 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:48.811611 3617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:48.811862 3617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:48.814036 3617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "90dfdcce2cef45bab3bdcc75a9f667de"
format_stamp: "Formatted at 2026-08-06 02:17:48 on dist-test-slave-gkw7"
server_key: "54ccb1086945bc32812b5d070d7b568b"
server_key_iv: "e0f5f04d2bcb463055952c9c77e21678"
server_key_version: "encryptionkey@0"
I20260806 02:17:48.814639 3617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "90dfdcce2cef45bab3bdcc75a9f667de"
format_stamp: "Formatted at 2026-08-06 02:17:48 on dist-test-slave-gkw7"
server_key: "54ccb1086945bc32812b5d070d7b568b"
server_key_iv: "e0f5f04d2bcb463055952c9c77e21678"
server_key_version: "encryptionkey@0"
I20260806 02:17:48.818555 3617 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 02:17:48.821002 3637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:48.822413 3617 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:17:48.822577 3617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "90dfdcce2cef45bab3bdcc75a9f667de"
format_stamp: "Formatted at 2026-08-06 02:17:48 on dist-test-slave-gkw7"
server_key: "54ccb1086945bc32812b5d070d7b568b"
server_key_iv: "e0f5f04d2bcb463055952c9c77e21678"
server_key_version: "encryptionkey@0"
I20260806 02:17:48.822695 3617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:48.837208 3617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:48.840497 3617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:48.840706 3617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:48.848042 3617 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:40257
I20260806 02:17:48.848356 3713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:40257 every 8 connection(s)
I20260806 02:17:48.849059 3617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:48.851886 3714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:48.856236 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 3617
I20260806 02:17:48.856377 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:48.856688 27382 external_mini_cluster.cc:1428] Setting key 7ee69b22436f9618ab01772d27517ca1
I20260806 02:17:48.858219 3714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de: Bootstrap starting.
I20260806 02:17:48.861008 3714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:48.861980 3714 log.cc:824] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:48.864282 3714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de: No bootstrap required, opened a new log
Aug 06 02:17:48 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:48.868312 3714 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } }
I20260806 02:17:48.868618 3714 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:48.868680 3714 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90dfdcce2cef45bab3bdcc75a9f667de, State: Initialized, Role: FOLLOWER
I20260806 02:17:48.869237 3714 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } }
I20260806 02:17:48.869410 3714 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:48.869477 3714 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:48.869596 3714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:48.870790 3714 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } }
I20260806 02:17:48.871230 3714 leader_election.cc:302] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90dfdcce2cef45bab3bdcc75a9f667de; no voters:
I20260806 02:17:48.871565 3714 leader_election.cc:288] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:48.871687 3722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:48.871958 3722 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 1 LEADER]: Becoming Leader. State: Replica: 90dfdcce2cef45bab3bdcc75a9f667de, State: Running, Role: LEADER
I20260806 02:17:48.872318 3722 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } }
I20260806 02:17:48.872822 3714 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:48.873711 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:48.858138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60658 (local address 127.26.189.190:40257)
0806 02:17:48.858578 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:48.858599 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:48.858643 (+ 44us) server_negotiation.cc:407] Connection header received
0806 02:17:48.859482 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:48.859510 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:48.859946 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:48.860301 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:48.861013 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:48.862540 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:48.863696 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:48.864391 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:48.864544 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:48.867832 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:48.867838 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:48.867854 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:48.867884 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:48.870096 (+ 2212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:48.870586 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:48.870595 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:48.870602 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:48.870791 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:48.871126 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:48.871130 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:48.871131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:48.871688 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:48.871912 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:48.872369 (+ 457us) server_negotiation.cc:299] Negotiation successful
0806 02:17:48.872689 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":141,"threads_started":1}
I20260806 02:17:48.874068 3724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90dfdcce2cef45bab3bdcc75a9f667de. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } }
I20260806 02:17:48.874189 3724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:48.874492 3723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } }
I20260806 02:17:48.874588 3723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:48.874577 3738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:48.877703 3738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:48.883782 3738 catalog_manager.cc:1347] Generated new cluster ID: bd474ef98e13448cbeaaf9c45a767a4d
I20260806 02:17:48.883857 3738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:48.893096 3738 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:48.894093 3738 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:48.897951 3738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de: Generated new TSK 0
I20260806 02:17:48.898605 3738 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab.
Entry for principal oryx/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab.
I20260806 02:17:48.942157 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:40257
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab
--principal=oryx/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:44885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:49.098989 3752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:49.099289 3752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:49.099335 3752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:49.103555 3752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:49.103632 3752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:49.103693 3752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:49.109112 3752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:44885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab
--principal=oryx/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:40257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:49.110330 3752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:49.111461 3752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:49.121991 3760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:49.122014 3759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:49.122100 3763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:49.122440 3752 server_base.cc:1034] running on GCE node
I20260806 02:17:49.122877 3752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:49.123523 3752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:49.124687 3752 hybrid_clock.cc:648] HybridClock initialized: now 1785982669124674 us; error 27 us; skew 500 ppm
Aug 06 02:17:49 dist-test-slave-gkw7 krb5kdc[3602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982669, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:49.127907 3752 init.cc:377] Logged in from keytab as oryx/127.26.189.129@KRBTEST.COM (short username oryx)
I20260806 02:17:49.128981 3752 webserver.cc:460] Webserver started at http://127.26.189.129:42557/ using document root <none> and password file <none>
I20260806 02:17:49.129652 3752 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:49.129724 3752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:49.129980 3752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:49.132161 3752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "a1213b43a4bb4c86bd8fcbb05379fb59"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "89829d2b39755ff532c3739b0ea7e2f9"
server_key_iv: "c293b4a26d0f86cc26f593793944bc19"
server_key_version: "encryptionkey@0"
I20260806 02:17:49.132766 3752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "a1213b43a4bb4c86bd8fcbb05379fb59"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "89829d2b39755ff532c3739b0ea7e2f9"
server_key_iv: "c293b4a26d0f86cc26f593793944bc19"
server_key_version: "encryptionkey@0"
I20260806 02:17:49.136842 3752 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:17:49.139598 3771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:49.141049 3752 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 02:17:49.141163 3752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "a1213b43a4bb4c86bd8fcbb05379fb59"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "89829d2b39755ff532c3739b0ea7e2f9"
server_key_iv: "c293b4a26d0f86cc26f593793944bc19"
server_key_version: "encryptionkey@0"
I20260806 02:17:49.141288 3752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:49.155594 3752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:49.159310 3752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:49.159596 3752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:49.160292 3752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:49.161234 3752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:49.161290 3752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:49.161336 3752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:49.161403 3752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:49.171707 3752 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:38345
I20260806 02:17:49.171765 3930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:38345 every 8 connection(s)
I20260806 02:17:49.172819 3752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:49.182279 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 3752
I20260806 02:17:49.182446 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:17:49.182875 27382 external_mini_cluster.cc:1428] Setting key a3a8b701135f75df18e959b1248dc8d3
Aug 06 02:17:49 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982669, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:49.189577 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.175035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:59507 (local address 127.26.189.190:40257)
0806 02:17:49.175197 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:49.175201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:49.176237 (+ 1036us) server_negotiation.cc:407] Connection header received
0806 02:17:49.177793 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:49.177796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:49.177849 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:49.177938 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:49.179254 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.179817 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.181190 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.181442 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.181704 (+ 262us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.185171 (+ 3467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:49.185176 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:49.185179 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:49.185209 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:49.187077 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.187799 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.187803 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.187804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.187900 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.188353 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.188356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.188358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.188555 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:49.188662 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:49.189239 (+ 577us) server_negotiation.cc:299] Negotiation successful
0806 02:17:49.189378 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 02:17:49.190452 3934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.175521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.129:59507)
0806 02:17:49.176049 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:49.176106 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:49.177556 (+ 1450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:49.178122 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:49.178129 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:49.178527 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:49.179074 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.179092 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.179995 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.179998 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.181008 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.181020 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.181824 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.181828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.182104 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.182851 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:49.182876 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:49.184967 (+ 2091us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:49.187220 (+ 2253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.187229 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.187251 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.187666 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.188015 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.188019 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.188023 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.188228 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.188686 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:49.188692 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:49.188979 (+ 287us) client_negotiation.cc:769] Sending connection context
0806 02:17:49.189195 (+ 216us) client_negotiation.cc:240] Negotiation successful
0806 02:17:49.189578 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":122,"threads_started":1}
I20260806 02:17:49.191897 3931 heartbeater.cc:347] Connected to a master server at 127.26.189.190:40257
I20260806 02:17:49.192227 3931 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:49.192778 3931 heartbeater.cc:511] Master 127.26.189.190:40257 requested a full tablet report, sending...
I20260806 02:17:49.194679 3665 ts_manager.cc:194] Registered new tserver with Master: a1213b43a4bb4c86bd8fcbb05379fb59 (127.26.189.129:38345)
WARNING: no policy specified for oryx/127.26.189.130@KRBTEST.COM; defaulting to no policy
I20260806 02:17:49.196013 3665 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:59507
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab.
Entry for principal oryx/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab.
I20260806 02:17:49.216889 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:40257
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab
--principal=oryx/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:44885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:49.339183 3939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:49.339457 3939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:49.339500 3939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:49.343760 3939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:49.343824 3939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:49.343883 3939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:49.349360 3939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:44885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab
--principal=oryx/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:40257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:49.350493 3939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:49.351526 3939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 02:17:49.361780 3939 server_base.cc:1034] running on GCE node
W20260806 02:17:49.361727 3947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:49.361737 3949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:49.361722 3951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:49.362425 3939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:49.363132 3939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:49.364302 3939 hybrid_clock.cc:648] HybridClock initialized: now 1785982669364260 us; error 55 us; skew 500 ppm
Aug 06 02:17:49 dist-test-slave-gkw7 krb5kdc[3602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982669, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:49.370476 3939 init.cc:377] Logged in from keytab as oryx/127.26.189.130@KRBTEST.COM (short username oryx)
I20260806 02:17:49.371510 3939 webserver.cc:460] Webserver started at http://127.26.189.130:35161/ using document root <none> and password file <none>
I20260806 02:17:49.372120 3939 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:49.372184 3939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:49.372447 3939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:49.375007 3939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "ba92d15617ab488b859f55bff4b37804"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "0cf11c091d8627b6aeb36b99d286043c"
server_key_iv: "4ee740ec9b2c3ab8ad45f22b07849b08"
server_key_version: "encryptionkey@0"
I20260806 02:17:49.375612 3939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "ba92d15617ab488b859f55bff4b37804"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "0cf11c091d8627b6aeb36b99d286043c"
server_key_iv: "4ee740ec9b2c3ab8ad45f22b07849b08"
server_key_version: "encryptionkey@0"
I20260806 02:17:49.379592 3939 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:49.382321 3963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:49.383702 3939 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:49.383842 3939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "ba92d15617ab488b859f55bff4b37804"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "0cf11c091d8627b6aeb36b99d286043c"
server_key_iv: "4ee740ec9b2c3ab8ad45f22b07849b08"
server_key_version: "encryptionkey@0"
I20260806 02:17:49.383958 3939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:49.402375 3939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:49.405519 3939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:49.405779 3939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:49.406338 3939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:49.407156 3939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:49.407205 3939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:49.407246 3939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:49.407262 3939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:49.417109 3939 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:44587
I20260806 02:17:49.417136 4111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:44587 every 8 connection(s)
I20260806 02:17:49.418073 3939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:49.424947 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 3939
I20260806 02:17:49.425045 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:17:49.425369 27382 external_mini_cluster.cc:1428] Setting key 26db362337ac0d9c849941b3f8ac2e16
Aug 06 02:17:49 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982669, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:49.433089 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.420032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:47969 (local address 127.26.189.190:40257)
0806 02:17:49.420194 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:49.420198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:49.420987 (+ 789us) server_negotiation.cc:407] Connection header received
0806 02:17:49.422485 (+ 1498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:49.422488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:49.422536 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:49.422614 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:49.423845 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.424383 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.425753 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.426081 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.426207 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.429322 (+ 3115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:49.429328 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:49.429332 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:49.429364 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:49.430924 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.431489 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.431494 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.431496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.431579 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.431939 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.431944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.431946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.432137 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:49.432257 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:49.432785 (+ 528us) server_negotiation.cc:299] Negotiation successful
0806 02:17:49.432922 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 02:17:49.434017 4114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.420362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.130:47969)
0806 02:17:49.420817 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:49.420871 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:49.422281 (+ 1410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:49.422781 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:49.422788 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:49.423175 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:49.423675 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.423689 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.424499 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.424501 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.425626 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.425637 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.426251 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.426255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.426503 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.427137 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:49.427155 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:49.429088 (+ 1933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:49.431071 (+ 1983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.431077 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.431094 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.431374 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.431683 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.431687 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.431689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.431839 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.432256 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:49.432263 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:49.432520 (+ 257us) client_negotiation.cc:769] Sending connection context
0806 02:17:49.432729 (+ 209us) client_negotiation.cc:240] Negotiation successful
0806 02:17:49.433076 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":107,"threads_started":1}
I20260806 02:17:49.435253 4112 heartbeater.cc:347] Connected to a master server at 127.26.189.190:40257
I20260806 02:17:49.435518 4112 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:49.436017 4112 heartbeater.cc:511] Master 127.26.189.190:40257 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.26.189.131@KRBTEST.COM; defaulting to no policy
I20260806 02:17:49.437266 3665 ts_manager.cc:194] Registered new tserver with Master: ba92d15617ab488b859f55bff4b37804 (127.26.189.130:44587)
I20260806 02:17:49.437933 3665 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:47969
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab.
Entry for principal oryx/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab.
I20260806 02:17:49.457233 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:40257
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab
--principal=oryx/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:44885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:49.575435 4120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:49.575736 4120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:49.575783 4120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:49.579856 4120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:49.579931 4120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:49.579998 4120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:49.585448 4120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:44885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab
--principal=oryx/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:40257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:49.586674 4120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:49.587872 4120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:49.598085 4130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:49.598085 4126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:49.598219 4127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:49.598626 4120 server_base.cc:1034] running on GCE node
I20260806 02:17:49.599027 4120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:49.599699 4120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:49.600864 4120 hybrid_clock.cc:648] HybridClock initialized: now 1785982669600831 us; error 45 us; skew 500 ppm
Aug 06 02:17:49 dist-test-slave-gkw7 krb5kdc[3602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982669, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:49.603896 4120 init.cc:377] Logged in from keytab as oryx/127.26.189.131@KRBTEST.COM (short username oryx)
I20260806 02:17:49.604825 4120 webserver.cc:460] Webserver started at http://127.26.189.131:33809/ using document root <none> and password file <none>
I20260806 02:17:49.605432 4120 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:49.605535 4120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:49.605799 4120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:49.607978 4120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "07dd0041edd843e7a3b6b9ae5dfeef74"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "3dc11a7b06e5c6f67fbb045d213c2b42"
server_key_iv: "613b5833ea39ad8db572deb24d90093c"
server_key_version: "encryptionkey@0"
I20260806 02:17:49.608595 4120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "07dd0041edd843e7a3b6b9ae5dfeef74"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "3dc11a7b06e5c6f67fbb045d213c2b42"
server_key_iv: "613b5833ea39ad8db572deb24d90093c"
server_key_version: "encryptionkey@0"
I20260806 02:17:49.612764 4120 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260806 02:17:49.615487 4139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:49.616770 4120 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 02:17:49.616930 4120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "07dd0041edd843e7a3b6b9ae5dfeef74"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "3dc11a7b06e5c6f67fbb045d213c2b42"
server_key_iv: "613b5833ea39ad8db572deb24d90093c"
server_key_version: "encryptionkey@0"
I20260806 02:17:49.617053 4120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:49.636543 4120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:49.640163 4120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:49.640391 4120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:49.641031 4120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:49.642020 4120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:49.642100 4120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:49.642174 4120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:49.642227 4120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:49.652156 4120 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:34487
I20260806 02:17:49.652179 4303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:34487 every 8 connection(s)
I20260806 02:17:49.653069 4120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:49.654819 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 4120
I20260806 02:17:49.654913 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:17:49.655296 27382 external_mini_cluster.cc:1428] Setting key 17eb30512ccfecdc55912e770b160168
Aug 06 02:17:49 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982669, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:49.667146 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.655194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:41131 (local address 127.26.189.190:40257)
0806 02:17:49.655379 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:49.655384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:49.656318 (+ 934us) server_negotiation.cc:407] Connection header received
0806 02:17:49.657810 (+ 1492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:49.657814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:49.657869 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:49.657948 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:49.659176 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.659725 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.660899 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.661147 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.661267 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.663910 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:49.663913 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:49.663915 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:49.663939 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:49.665220 (+ 1281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.665817 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.665820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.665821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.665898 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.666222 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.666225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.666227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.666396 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:49.666472 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:49.666925 (+ 453us) server_negotiation.cc:299] Negotiation successful
0806 02:17:49.667024 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 02:17:49.668124 4307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.655671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.131:41131)
0806 02:17:49.656167 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:49.656222 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:49.657585 (+ 1363us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:49.658121 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:49.658128 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:49.658518 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:49.659007 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.659021 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.659861 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.659865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.660758 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.660767 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.661308 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.661312 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.661490 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.662168 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:49.662184 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:49.663741 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:49.665334 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.665339 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.665351 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.665720 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.665978 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.665980 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.665981 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.666124 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.666484 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:49.666489 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:49.666717 (+ 228us) client_negotiation.cc:769] Sending connection context
0806 02:17:49.666866 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 02:17:49.667115 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":145,"threads_started":1}
I20260806 02:17:49.669471 4304 heartbeater.cc:347] Connected to a master server at 127.26.189.190:40257
I20260806 02:17:49.669785 4304 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:49.670301 4304 heartbeater.cc:511] Master 127.26.189.190:40257 requested a full tablet report, sending...
I20260806 02:17:49.671375 3663 ts_manager.cc:194] Registered new tserver with Master: 07dd0041edd843e7a3b6b9ae5dfeef74 (127.26.189.131:34487)
I20260806 02:17:49.671998 3663 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:41131
I20260806 02:17:49.681442 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.189.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.189.keytab.
Entry for principal oryx/127.26.189.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.189.keytab.
I20260806 02:17:49.713256 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.189:42455
--webserver_interface=127.26.189.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.189.keytab
--principal=oryx/127.26.189.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:44885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:40257,127.26.189.189:42455
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:49.832249 4310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:49.832572 4310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:49.832649 4310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:49.836819 4310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:49.836923 4310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:49.836966 4310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:49.836999 4310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:49.837028 4310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:49.842658 4310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:44885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:40257,127.26.189.189:42455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.189.keytab
--principal=oryx/127.26.189.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.189:42455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.189.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
W20260806 02:17:49.842948 4310 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.26.189.190:40257,127.26.189.189:42455'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 02:17:49.843926 4310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:49.845125 4310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:49.854770 4319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:49.855000 4322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:49.854964 4310 server_base.cc:1034] running on GCE node
W20260806 02:17:49.854786 4320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:49.855891 4310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:49.857095 4310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:49.858328 4310 hybrid_clock.cc:648] HybridClock initialized: now 1785982669858314 us; error 31 us; skew 500 ppm
Aug 06 02:17:49 dist-test-slave-gkw7 krb5kdc[3602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982669, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:49.861245 4310 init.cc:377] Logged in from keytab as oryx/127.26.189.189@KRBTEST.COM (short username oryx)
I20260806 02:17:49.862267 4310 webserver.cc:460] Webserver started at http://127.26.189.189:41915/ using document root <none> and password file <none>
I20260806 02:17:49.862865 4310 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:49.862928 4310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:49.863188 4310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:49.865306 4310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data/instance:
uuid: "5c3fe87e80294bcd9b935119e4dec5f4"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "3aa9e979f64745dfc53c093418d66752"
server_key_iv: "0b314d34508ee6f9e7d725adc500d9c6"
server_key_version: "encryptionkey@0"
I20260806 02:17:49.865950 4310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/wal/instance:
uuid: "5c3fe87e80294bcd9b935119e4dec5f4"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "3aa9e979f64745dfc53c093418d66752"
server_key_iv: "0b314d34508ee6f9e7d725adc500d9c6"
server_key_version: "encryptionkey@0"
I20260806 02:17:49.869820 4310 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:49.872366 4332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:49.873878 4310 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:49.874034 4310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/wal
uuid: "5c3fe87e80294bcd9b935119e4dec5f4"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "3aa9e979f64745dfc53c093418d66752"
server_key_iv: "0b314d34508ee6f9e7d725adc500d9c6"
server_key_version: "encryptionkey@0"
I20260806 02:17:49.874154 4310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:49.893129 4310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:49.896525 4310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:49.896759 4310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:49.904105 4310 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.189:42455
I20260806 02:17:49.904424 4400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.189:42455 every 8 connection(s)
I20260806 02:17:49.905151 4310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
I20260806 02:17:49.908026 4401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:49.911375 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 4310
I20260806 02:17:49.911856 4401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 02:17:49 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982669, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.189@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
Aug 06 02:17:49 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.189.189@KRBTEST.COM
I20260806 02:17:49.925981 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.913906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60662 (local address 127.26.189.190:40257)
0806 02:17:49.914045 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:49.914051 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:49.914328 (+ 277us) server_negotiation.cc:407] Connection header received
0806 02:17:49.914704 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:49.914707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:49.914759 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:49.914843 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:49.915916 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.916727 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.918186 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.918535 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.918651 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.921688 (+ 3037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:49.921692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:49.921695 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:49.921731 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:49.923400 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.924012 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.924018 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.924021 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.924130 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.924625 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.924630 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.924633 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.924934 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:49.925060 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:49.925607 (+ 547us) server_negotiation.cc:299] Negotiation successful
0806 02:17:49.925734 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 02:17:49.926860 4406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.913814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:60662)
0806 02:17:49.914174 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:49.914223 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:49.914491 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:49.914924 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:49.914931 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:49.915407 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:49.915765 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.915785 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.916858 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.916860 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.918063 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.918074 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.918691 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.918693 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.918852 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.919656 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:49.919678 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:49.921436 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:49.923517 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.923524 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.923532 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.923897 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.924249 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.924252 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.924254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.924461 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.925058 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:49.925065 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:49.925335 (+ 270us) client_negotiation.cc:769] Sending connection context
0806 02:17:49.925539 (+ 204us) client_negotiation.cc:240] Negotiation successful
0806 02:17:49.925881 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":1,"thread_start_us":97,"threads_started":1}
I20260806 02:17:49.926862 4405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.912939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38056 (local address 127.26.189.189:42455)
0806 02:17:49.913368 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:49.913387 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:49.913428 (+ 41us) server_negotiation.cc:407] Connection header received
0806 02:17:49.914252 (+ 824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:49.914271 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:49.914544 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:49.914748 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:49.915714 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.917001 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.918186 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.918770 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.918859 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.922121 (+ 3262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:49.922126 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:49.922136 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:49.922179 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:49.924095 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.924842 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.924848 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.924849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.924934 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.925228 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.925233 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.925235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.925468 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:49.925705 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:49.925896 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 02:17:49.926091 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":290,"thread_start_us":110,"threads_started":1}
I20260806 02:17:49.928498 4401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 02:17:49 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982669, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.189@KRBTEST.COM for oryx/127.26.189.189@KRBTEST.COM
I20260806 02:17:49.936817 4406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.929052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:42455 (local address 127.0.0.1:38060)
0806 02:17:49.929217 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:49.929231 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:49.929331 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:49.929700 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:49.929702 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:49.929833 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:49.929908 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.929913 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.931010 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.931013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.931538 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.931546 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.931967 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.931970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.932042 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.932557 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:49.932569 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:49.933909 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:49.935461 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.935464 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.935465 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.935646 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.935962 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.935964 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.935965 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.936038 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.936400 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:49.936402 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:49.936476 (+ 74us) client_negotiation.cc:769] Sending connection context
0806 02:17:49.936557 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 02:17:49.936668 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260806 02:17:49.936851 4405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.929119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38060 (local address 127.26.189.189:42455)
0806 02:17:49.929223 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:49.929227 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:49.929278 (+ 51us) server_negotiation.cc:407] Connection header received
0806 02:17:49.929415 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:49.929417 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:49.929453 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:49.929582 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:49.929994 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.930907 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.931641 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.931868 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.931948 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.934032 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:49.934036 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:49.934037 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:49.934058 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:49.935363 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.935767 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.935771 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.935772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.935868 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.936132 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.936135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.936136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.936313 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:49.936399 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:49.936626 (+ 227us) server_negotiation.cc:299] Negotiation successful
0806 02:17:49.936727 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 02:17:49.939898 4401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: Bootstrap starting.
I20260806 02:17:49.942440 4401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:49.943224 4401 log.cc:824] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:49.945369 4401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: No bootstrap required, opened a new log
I20260806 02:17:49.948500 4401 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } }
I20260806 02:17:49.948710 4401 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:49.948781 4401 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c3fe87e80294bcd9b935119e4dec5f4, State: Initialized, Role: FOLLOWER
I20260806 02:17:49.949230 4401 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } }
I20260806 02:17:49.949810 4409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } } }
I20260806 02:17:49.949950 4409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:17:49.950563 4401 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 02:17:49.955206 4425 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:17:49.955299 4425 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:17:49.958371 4310 master_runner.cc:428] Detected that this master 5c3fe87e80294bcd9b935119e4dec5f4 is joining an existing cluster
I20260806 02:17:49.958447 4310 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.189.189:42455
I20260806 02:17:49.969561 4405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.961044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38066 (local address 127.26.189.189:42455)
0806 02:17:49.961177 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:49.961181 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:49.961720 (+ 539us) server_negotiation.cc:407] Connection header received
0806 02:17:49.961857 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:49.961860 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:49.961904 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:49.961982 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:49.962674 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.963410 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.964536 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.964812 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.964909 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.966054 (+ 1145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:49.966057 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:49.966060 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:49.966086 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:49.967683 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.968106 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.968112 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.968114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.968191 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.968519 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.968524 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.968526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.968763 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:49.968874 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:49.969216 (+ 342us) server_negotiation.cc:299] Negotiation successful
0806 02:17:49.969336 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":40}
I20260806 02:17:49.969988 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.961127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60674 (local address 127.26.189.190:40257)
0806 02:17:49.961270 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:49.961275 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:49.961563 (+ 288us) server_negotiation.cc:407] Connection header received
0806 02:17:49.961811 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:49.961817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:49.961880 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:49.961974 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:49.962497 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.963038 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.963891 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.964127 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.964254 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.965955 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:49.965959 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:49.965962 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:49.965991 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:49.967981 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.968667 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.968671 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.968673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.968758 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.969037 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.969041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.969043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.969228 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:49.969335 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:49.969633 (+ 298us) server_negotiation.cc:299] Negotiation successful
0806 02:17:49.969835 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 02:17:49.970091 4433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.961290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:42455 (local address 127.0.0.1:38066)
0806 02:17:49.961624 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:49.961636 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:49.961765 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:49.962115 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:49.962118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:49.962403 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:49.962539 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.962547 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.963548 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.963551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.964402 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.964414 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.964908 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.964912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.965028 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.965463 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:49.965477 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:49.965930 (+ 453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:49.967802 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.967807 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.967810 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.968003 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.968291 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.968293 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.968295 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.968402 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.968914 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:49.968917 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:49.969019 (+ 102us) client_negotiation.cc:769] Sending connection context
0806 02:17:49.969748 (+ 729us) client_negotiation.cc:240] Negotiation successful
0806 02:17:49.969890 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":1,"thread_start_us":103,"threads_started":1}
I20260806 02:17:49.970520 4432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.961027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:60674)
0806 02:17:49.961442 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:49.961459 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:49.961649 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:49.961990 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:49.961993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:49.962268 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:49.962377 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.962383 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.963153 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.963156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.963765 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.963774 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.964265 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.964269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.964358 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.965208 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:49.965217 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:49.965800 (+ 583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:49.968297 (+ 2497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.968300 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.968302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.968563 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.968851 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.968855 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.968857 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.968942 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.969338 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:49.969342 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:49.969445 (+ 103us) client_negotiation.cc:769] Sending connection context
0806 02:17:49.969576 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 02:17:49.970003 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":107,"threads_started":1}
Aug 06 02:17:49 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982668, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.190@KRBTEST.COM for oryx/127.26.189.189@KRBTEST.COM
I20260806 02:17:49.985783 4405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.975626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38074 (local address 127.26.189.189:42455)
0806 02:17:49.975745 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:49.975751 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:49.976070 (+ 319us) server_negotiation.cc:407] Connection header received
0806 02:17:49.976257 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:49.976261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:49.976319 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:49.976416 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:49.977103 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.977912 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.978958 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.979309 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.979423 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.981964 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:49.981968 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:49.981971 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:49.981995 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:49.983712 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.984335 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.984340 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.984342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.984441 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:49.984773 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:49.984775 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:49.984777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:49.984944 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:49.985021 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:49.985464 (+ 443us) server_negotiation.cc:299] Negotiation successful
0806 02:17:49.985629 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 02:17:49.985848 4434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:49.975581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:42455 (local address 127.0.0.1:38074)
0806 02:17:49.975925 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:49.975975 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:49.976110 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:49.976512 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:49.976517 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:49.976858 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:49.976976 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.976982 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.978023 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.978026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.978815 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:49.978847 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:49.979421 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:49.979424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:49.979565 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:49.980136 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:49.980151 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:49.981822 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:49.983845 (+ 2023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.983857 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.983865 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.984214 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.984556 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:49.984560 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:49.984562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:49.984671 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:49.985064 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:49.985073 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:49.985223 (+ 150us) client_negotiation.cc:769] Sending connection context
0806 02:17:49.985399 (+ 176us) client_negotiation.cc:240] Negotiation successful
0806 02:17:49.985669 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":101,"threads_started":1}
I20260806 02:17:49.987479 3663 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.189.189:42455: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4"
member_type: NON_VOTER
last_known_addr {
host: "127.26.189.189"
port: 42455
}
attrs {
promote: true
}
}
dest_uuid: "90dfdcce2cef45bab3bdcc75a9f667de"
cas_config_opid_index: -1
I20260806 02:17:49.988271 3663 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } }
I20260806 02:17:49.990087 4438 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5c3fe87e80294bcd9b935119e4dec5f4 (127.26.189.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } }
I20260806 02:17:49.990753 4368 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:49.991633 4438 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.189.189:42455
I20260806 02:17:49.992123 4310 master.cc:537] Master@127.26.189.189:42455 shutting down...
I20260806 02:17:49.992148 4437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } }
I20260806 02:17:49.992252 4437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:49.992281 4368 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 FOLLOWER]: Refusing update from remote peer 90dfdcce2cef45bab3bdcc75a9f667de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 02:17:49.992982 4437 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 02:17:49.995918 3638 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
WARNING: no policy specified for oryx/127.26.189.188@KRBTEST.COM; defaulting to no policy
W20260806 02:17:49.997610 3638 consensus_peers.cc:487] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de -> Peer 5c3fe87e80294bcd9b935119e4dec5f4 (127.26.189.189:42455): Couldn't send request to peer 5c3fe87e80294bcd9b935119e4dec5f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 02:17:49.997923 4310 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:49.998231 4310 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:49.998359 4310 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.188@KRBTEST.COM" created.
I20260806 02:17:50.005352 4310 master.cc:552] Master@127.26.189.189:42455 shutdown complete.
I20260806 02:17:50.005414 4310 master_runner.cc:305] Clearing existing system tablet
I20260806 02:17:50.005679 4310 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:50.005730 4310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:50.006834 4310 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:50.007716 4446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:50.007956 4310 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:50.008121 4310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:50.008160 4310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/wal
uuid: "5c3fe87e80294bcd9b935119e4dec5f4"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "3aa9e979f64745dfc53c093418d66752"
server_key_iv: "0b314d34508ee6f9e7d725adc500d9c6"
server_key_version: "encryptionkey@0"
I20260806 02:17:50.010053 4310 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:50.012148 4310 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 02:17:50.012270 4310 log.cc:1196] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 02:17:50.012550 4310 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: Deleting consensus metadata
I20260806 02:17:50.012748 4310 master_runner.cc:315] Copying system tablet from 127.26.189.190:40257
I20260806 02:17:50.014184 4310 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: tablet copy: Beginning tablet copy session from remote peer at address 127.26.189.190:40257
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.188.keytab.
Entry for principal oryx/127.26.189.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.188.keytab.
I20260806 02:17:50.023865 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.014982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60688 (local address 127.26.189.190:40257)
0806 02:17:50.015138 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.015141 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.015253 (+ 112us) server_negotiation.cc:407] Connection header received
0806 02:17:50.015419 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.015421 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.015463 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.015537 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.016226 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.016853 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.018274 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.018544 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.018637 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.020086 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.020089 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.020091 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.020138 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.021910 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.022461 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.022463 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.022465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.022538 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.022893 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.022895 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.022896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.023070 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.023147 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.023542 (+ 395us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.023678 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 02:17:50.024399 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.188:41015
--webserver_interface=127.26.189.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.188.keytab
--principal=oryx/127.26.189.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:44885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:40257,127.26.189.189:42455,127.26.189.188:41015
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:17:50.024506 4456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.014845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:60688)
0806 02:17:50.015167 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.015184 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.015317 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.015626 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.015630 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.015897 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.016022 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.016030 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.016988 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.016993 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.018128 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.018140 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.018657 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.018661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.018766 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.019400 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.019417 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.019936 (+ 519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.022001 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.022005 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.022007 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.022368 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.022636 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.022639 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.022642 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.022800 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.023210 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.023213 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.023324 (+ 111us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.024125 (+ 801us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.024295 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":103,"threads_started":1}
I20260806 02:17:50.025331 3690 tablet_copy_service.cc:140] P 90dfdcce2cef45bab3bdcc75a9f667de: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 5c3fe87e80294bcd9b935119e4dec5f4 ({username='oryx', principal='oryx/127.26.189.189@KRBTEST.COM'} at 127.0.0.1:60688)
I20260806 02:17:50.025611 3690 tablet_copy_service.cc:161] P 90dfdcce2cef45bab3bdcc75a9f667de: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 5c3fe87e80294bcd9b935119e4dec5f4 at {username='oryx', principal='oryx/127.26.189.189@KRBTEST.COM'} at 127.0.0.1:60688: session id = 5c3fe87e80294bcd9b935119e4dec5f4-00000000000000000000000000000000
I20260806 02:17:50.027694 3690 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 02:17:50.029439 4310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 02:17:50.031937 4310 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: tablet copy: Starting download of 0 data blocks...
I20260806 02:17:50.032168 4310 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: tablet copy: Starting download of 1 WAL segments...
I20260806 02:17:50.033989 4310 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 02:17:50.035621 3690 tablet_copy_service.cc:342] P 90dfdcce2cef45bab3bdcc75a9f667de: Request end of tablet copy session 5c3fe87e80294bcd9b935119e4dec5f4-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.189.189@KRBTEST.COM'} at 127.0.0.1:60688
I20260806 02:17:50.035753 3690 tablet_copy_service.cc:433] P 90dfdcce2cef45bab3bdcc75a9f667de: ending tablet copy session 5c3fe87e80294bcd9b935119e4dec5f4-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 5c3fe87e80294bcd9b935119e4dec5f4
I20260806 02:17:50.045099 4310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:50.046927 4458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:50.047189 4462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:50.047362 4310 server_base.cc:1034] running on GCE node
W20260806 02:17:50.049722 4460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:50.049955 4310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:50.050302 4310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:50.051478 4310 hybrid_clock.cc:648] HybridClock initialized: now 1785982670051476 us; error 51 us; skew 500 ppm
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:50.053247 4310 init.cc:377] Logged in from keytab as oryx/127.26.189.189@KRBTEST.COM (short username oryx)
I20260806 02:17:50.053822 4310 webserver.cc:460] Webserver started at http://127.26.189.189:35607/ using document root <none> and password file <none>
I20260806 02:17:50.054041 4310 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:50.054100 4310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:50.055258 4310 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:50.056252 4477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:50.056494 4310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:50.056567 4310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/wal
uuid: "5c3fe87e80294bcd9b935119e4dec5f4"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "3aa9e979f64745dfc53c093418d66752"
server_key_iv: "0b314d34508ee6f9e7d725adc500d9c6"
server_key_version: "encryptionkey@0"
I20260806 02:17:50.056663 4310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:50.066397 4310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:50.068490 4310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:50.073735 4310 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.189:42455
I20260806 02:17:50.073755 4560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.189:42455 every 8 connection(s)
I20260806 02:17:50.074504 4310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
I20260806 02:17:50.076179 4562 sys_catalog.cc:263] Verifying existing consensus state
I20260806 02:17:50.077018 4562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: Bootstrap starting.
I20260806 02:17:50.085875 4562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 02:17:50.086225 4562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: Bootstrap complete.
I20260806 02:17:50.086735 4562 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } }
I20260806 02:17:50.086877 4562 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c3fe87e80294bcd9b935119e4dec5f4, State: Initialized, Role: LEARNER
I20260806 02:17:50.087002 4562 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } }
I20260806 02:17:50.087400 4566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } }
I20260806 02:17:50.087565 4566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: This master's current role is: LEARNER
I20260806 02:17:50.087613 4562 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:50.090947 4579 catalog_manager.cc:1259] Loaded cluster ID: bd474ef98e13448cbeaaf9c45a767a4d
I20260806 02:17:50.091140 4579 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: loading cluster ID for follower catalog manager: success
I20260806 02:17:50.092684 4579 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: acquiring CA information for follower catalog manager: success
I20260806 02:17:50.093914 4579 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 02:17:50.198884 3931 heartbeater.cc:503] Master 127.26.189.190:40257 was elected leader, sending a full tablet report...
W20260806 02:17:50.204435 4457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:50.204766 4457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:50.204878 4457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:50.209566 4457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:50.209676 4457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:50.209719 4457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:50.209784 4457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:50.209826 4457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:50.215893 4457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:44885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:40257,127.26.189.189:42455,127.26.189.188:41015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.188.keytab
--principal=oryx/127.26.189.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.188:41015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.189.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:50.217078 4457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:50.218204 4457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:50.227458 4592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:50.227468 4588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:50.227445 4589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:50.227730 4457 server_base.cc:1034] running on GCE node
I20260806 02:17:50.228369 4457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:50.229497 4457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:50.230775 4457 hybrid_clock.cc:648] HybridClock initialized: now 1785982670230756 us; error 33 us; skew 500 ppm
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:50.234189 4457 init.cc:377] Logged in from keytab as oryx/127.26.189.188@KRBTEST.COM (short username oryx)
I20260806 02:17:50.235095 4457 webserver.cc:460] Webserver started at http://127.26.189.188:33225/ using document root <none> and password file <none>
I20260806 02:17:50.235653 4457 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:50.235715 4457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:50.235893 4457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:50.238070 4457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data/instance:
uuid: "41deb06d810c4ae3a8b07fd7371e9eb8"
format_stamp: "Formatted at 2026-08-06 02:17:50 on dist-test-slave-gkw7"
server_key: "966d9786a38bdb28ffa60159eb70385e"
server_key_iv: "bdc5cabbfec9fc4a483bee1f24fe4c94"
server_key_version: "encryptionkey@0"
I20260806 02:17:50.238615 4457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/wal/instance:
uuid: "41deb06d810c4ae3a8b07fd7371e9eb8"
format_stamp: "Formatted at 2026-08-06 02:17:50 on dist-test-slave-gkw7"
server_key: "966d9786a38bdb28ffa60159eb70385e"
server_key_iv: "bdc5cabbfec9fc4a483bee1f24fe4c94"
server_key_version: "encryptionkey@0"
I20260806 02:17:50.242507 4457 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:17:50.245136 4601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:50.246685 4457 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:50.246793 4457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/wal
uuid: "41deb06d810c4ae3a8b07fd7371e9eb8"
format_stamp: "Formatted at 2026-08-06 02:17:50 on dist-test-slave-gkw7"
server_key: "966d9786a38bdb28ffa60159eb70385e"
server_key_iv: "bdc5cabbfec9fc4a483bee1f24fe4c94"
server_key_version: "encryptionkey@0"
I20260806 02:17:50.246881 4457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:50.271632 4457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:50.275774 4457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:50.275971 4457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:50.283488 4457 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.188:41015
I20260806 02:17:50.283802 4677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.188:41015 every 8 connection(s)
I20260806 02:17:50.284693 4457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
I20260806 02:17:50.287603 4678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:50.291764 4678 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:17:50.294878 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 4457
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.188@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.189.188@KRBTEST.COM
I20260806 02:17:50.307308 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.293943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60696 (local address 127.26.189.190:40257)
0806 02:17:50.294109 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.294115 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.295324 (+ 1209us) server_negotiation.cc:407] Connection header received
0806 02:17:50.297086 (+ 1762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.297090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.297147 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.297249 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.298414 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.298967 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.300005 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.300258 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.300381 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.303171 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.303175 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.303182 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.303206 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.304831 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.305417 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.305419 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.305421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.305498 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.305924 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.305928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.305930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.306203 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.306306 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.306936 (+ 630us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.307065 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 02:17:50.308243 4684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.296468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46500 (local address 127.26.189.188:41015)
0806 02:17:50.296902 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.296912 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.296945 (+ 33us) server_negotiation.cc:407] Connection header received
0806 02:17:50.297107 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.297112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.297343 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.297566 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.298410 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.299275 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.300123 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.300504 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.300658 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.303533 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.303542 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.303558 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.303589 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.305510 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.306032 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.306036 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.306038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.306107 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.306391 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.306394 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.306396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.306704 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.306907 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.307148 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.307282 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":314,"spinlock_wait_cycles":2304,"thread_start_us":190,"threads_started":1}
I20260806 02:17:50.308243 4683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.294357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:60696)
0806 02:17:50.295119 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.295202 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.296834 (+ 1632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.297378 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.297388 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.297937 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.298254 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.298268 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.299111 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.299114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.299867 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.299877 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.300417 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.300421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.300592 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.301216 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.301232 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.303009 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.304956 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.304963 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.304974 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.305307 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.305647 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.305652 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.305654 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.305822 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.306313 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.306318 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.306688 (+ 370us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.306861 (+ 173us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.307199 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"mutex_wait_us":64,"spinlock_wait_cycles":768,"thread_start_us":182,"threads_started":1}
I20260806 02:17:50.309651 4678 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.188@KRBTEST.COM for oryx/127.26.189.189@KRBTEST.COM
I20260806 02:17:50.317929 4683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.310150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:42455 (local address 127.0.0.1:38082)
0806 02:17:50.310292 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.310307 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.310380 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.310790 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.310792 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.310916 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.311004 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.311009 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.311904 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.311907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.312435 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.312443 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.312878 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.312880 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.312952 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.313351 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.313362 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.314685 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.316514 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.316517 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.316518 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.316699 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.316975 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.316978 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.316980 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.317062 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.317470 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.317472 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.317618 (+ 146us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.317716 (+ 98us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.317812 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 02:17:50.318060 4686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.310278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38082 (local address 127.26.189.189:42455)
0806 02:17:50.310553 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.310558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.310571 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:17:50.310615 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.310620 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.310673 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.310756 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.311138 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.311802 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.312546 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.312779 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.312865 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.314825 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.314829 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.314830 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.314854 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.316408 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.316800 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.316802 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.316804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.316882 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.317186 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.317189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.317190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.317376 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.317466 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.317789 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.317900 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":105,"threads_started":1}
I20260806 02:17:50.318770 4678 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.188@KRBTEST.COM for oryx/127.26.189.188@KRBTEST.COM
I20260806 02:17:50.326435 4683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.319321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:41015 (local address 127.0.0.1:46510)
0806 02:17:50.319432 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.319448 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.319520 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.319795 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.319798 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.319947 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.320018 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.320023 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.320814 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.320821 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.321344 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.321352 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.321877 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.321881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.321952 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.322422 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.322433 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.323567 (+ 1134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.325001 (+ 1434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.325004 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.325005 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.325197 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.325432 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.325434 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.325435 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.325507 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.325952 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.325955 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.326034 (+ 79us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.326150 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.326304 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 02:17:50.326473 4684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.319395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46510 (local address 127.26.189.188:41015)
0806 02:17:50.319488 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.319492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.319506 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:17:50.319603 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.319624 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.319679 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.319759 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.320121 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.320673 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.321444 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.321755 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.321865 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.323688 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.323691 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.323693 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.323712 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.324902 (+ 1190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.325280 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.325283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.325284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.325352 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.325659 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.325669 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.325670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.325824 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.325902 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.326205 (+ 303us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.326357 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":32}
I20260806 02:17:50.330181 4678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: Bootstrap starting.
I20260806 02:17:50.332651 4678 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:50.333350 4678 log.cc:824] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:50.335402 4678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: No bootstrap required, opened a new log
I20260806 02:17:50.338404 4678 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } }
I20260806 02:17:50.338601 4678 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:50.338634 4678 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41deb06d810c4ae3a8b07fd7371e9eb8, State: Initialized, Role: FOLLOWER
I20260806 02:17:50.338995 4678 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } }
I20260806 02:17:50.339444 4688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } } }
I20260806 02:17:50.339600 4688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:17:50.340171 4678 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 02:17:50.345361 4706 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:17:50.345453 4706 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:17:50.349601 4457 master_runner.cc:428] Detected that this master 41deb06d810c4ae3a8b07fd7371e9eb8 is joining an existing cluster
I20260806 02:17:50.349677 4457 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.189.188:41015
I20260806 02:17:50.361989 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 3752
I20260806 02:17:50.362671 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.352276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60710 (local address 127.26.189.190:40257)
0806 02:17:50.352567 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.352575 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.353227 (+ 652us) server_negotiation.cc:407] Connection header received
0806 02:17:50.353360 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.353363 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.353419 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.353511 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.354246 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.355116 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.357013 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.357353 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.357430 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.359092 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.359096 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.359099 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.359129 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.360836 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.361358 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.361362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.361364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.361453 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.361787 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.361790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.361792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.362018 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.362094 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.362407 (+ 313us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.362520 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190}
I20260806 02:17:50.363139 4715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.352132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:60710)
0806 02:17:50.353101 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.353119 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.353243 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.353684 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.353688 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.353956 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.354099 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.354107 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.355267 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.355270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.356876 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.356887 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.357690 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.357693 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.357836 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.358412 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.358427 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.358940 (+ 513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.360964 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.360968 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.360970 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.361238 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.361586 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.361589 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.361591 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.361685 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.362168 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.362170 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.362254 (+ 84us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.362864 (+ 610us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.362991 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":834,"mutex_wait_us":150,"thread_start_us":112,"threads_started":1}
I20260806 02:17:50.374596 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:38345
--local_ip_for_outbound_sockets=127.26.189.129
--tserver_master_addrs=127.26.189.190:40257
--webserver_port=42557
--webserver_interface=127.26.189.129
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab
--principal=oryx/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:44885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.189.190:40257,127.26.189.189:42455
--tserver_master_addrs=127.26.189.190:40257,127.26.189.189:42455,127.26.189.188:41015 with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982668, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.190@KRBTEST.COM for oryx/127.26.189.188@KRBTEST.COM
I20260806 02:17:50.386688 4434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.369703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:41015 (local address 127.0.0.1:46532)
0806 02:17:50.369892 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.369907 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.369987 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.371639 (+ 1652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.371651 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.371848 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.371958 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.371965 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.373110 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.373114 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.374052 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.374066 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.374559 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.374563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.374672 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.375248 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.375263 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.376578 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.384422 (+ 7844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.384428 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.384432 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.384778 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.385176 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.385182 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.385186 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.385295 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.385933 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.385939 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.386092 (+ 153us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.386201 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.386406 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113}
I20260806 02:17:50.387923 4717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.369752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46532 (local address 127.26.189.188:41015)
0806 02:17:50.371326 (+ 1574us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.371335 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.371350 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:17:50.371429 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.371432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.371487 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.371586 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.372101 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.372984 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.374196 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.374436 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.374555 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.376784 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.376791 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.376795 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.376827 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.384253 (+ 7426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.384935 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.384941 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.384945 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.385050 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.385439 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.385444 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.385448 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.385796 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.387340 (+ 1544us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.387434 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.387589 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1498,"thread_start_us":100,"threads_started":1}
I20260806 02:17:50.389487 3663 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.189.188:41015: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8"
member_type: NON_VOTER
last_known_addr {
host: "127.26.189.188"
port: 41015
}
attrs {
promote: true
}
}
dest_uuid: "90dfdcce2cef45bab3bdcc75a9f667de"
cas_config_opid_index: 5
I20260806 02:17:50.390245 3663 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } }
I20260806 02:17:50.391327 4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.352714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:41015 (local address 127.0.0.1:46518)
0806 02:17:50.353466 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.353480 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.353609 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.353947 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.353949 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.354201 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.354309 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.354319 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.355463 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.355465 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.356863 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.356874 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.357684 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.357690 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.357869 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.382543 (+ 24674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.382560 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.383678 (+ 1118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.388870 (+ 5192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.388873 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.388876 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.389117 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.390220 (+ 1103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.390223 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.390225 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.390304 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.390778 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.390781 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.390871 (+ 90us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.390971 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.391131 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"mutex_wait_us":202,"thread_start_us":119,"threads_started":1}
I20260806 02:17:50.391808 4643 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:50.392313 4684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.352752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46518 (local address 127.26.189.188:41015)
0806 02:17:50.352884 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.352889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.353558 (+ 669us) server_negotiation.cc:407] Connection header received
0806 02:17:50.353708 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.353711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.353753 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.353808 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.354441 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.355350 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.356976 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.357347 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.357429 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.383855 (+ 26426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.383859 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.383863 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.383886 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.385740 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.389392 (+ 3652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.389396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.389398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.389501 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.390393 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.390396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.390398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.390610 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.390693 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.392022 (+ 1329us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.392158 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":53}
I20260806 02:17:50.392702 4712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.352149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:42455 (local address 127.0.0.1:38092)
0806 02:17:50.353193 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.353207 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.353350 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.353817 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.353820 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.354128 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.354278 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.354289 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.355458 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.355461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.356784 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.356796 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.357915 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.357919 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.358018 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.382381 (+ 24363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.382405 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.385938 (+ 3533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.388487 (+ 2549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.388490 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.388493 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.388750 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.389982 (+ 1232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.389986 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.389988 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.390076 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.392018 (+ 1942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.392022 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.392145 (+ 123us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.392281 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.392461 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":955,"mutex_wait_us":110,"thread_start_us":210,"threads_started":1}
I20260806 02:17:50.393355 4437 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 41deb06d810c4ae3a8b07fd7371e9eb8 (127.26.189.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:50.393620 4686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.352263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38092 (local address 127.26.189.189:42455)
0806 02:17:50.352436 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.352442 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.353283 (+ 841us) server_negotiation.cc:407] Connection header received
0806 02:17:50.353475 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.353479 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.353570 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.353652 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.354436 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.355303 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.356936 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.357347 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.357428 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.386144 (+ 28716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.386149 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.386152 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.386187 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.388301 (+ 2114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.389771 (+ 1470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.389775 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.389777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.389868 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.391582 (+ 1714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.391586 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.391589 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.391829 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.391926 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.393245 (+ 1319us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.393388 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 02:17:50.394114 4643 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 FOLLOWER]: Refusing update from remote peer 90dfdcce2cef45bab3bdcc75a9f667de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 02:17:50.394727 4438 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [LEADER]: Connected to new peer: Peer: permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:50.394939 4688 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:50.395115 4688 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } }
I20260806 02:17:50.396158 4688 leader_election.cc:288] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 90dfdcce2cef45bab3bdcc75a9f667de (127.26.189.190:40257), 5c3fe87e80294bcd9b935119e4dec5f4 (127.26.189.189:42455)
I20260806 02:17:50.396531 3676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" is_pre_election: true
I20260806 02:17:50.397261 4508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" is_pre_election: true
I20260806 02:17:50.397442 4508 raft_consensus.cc:1799] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 LEARNER]: Handling vote request from an unknown peer 41deb06d810c4ae3a8b07fd7371e9eb8
I20260806 02:17:50.397615 4508 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 LEARNER]: Leader pre-election vote request: Denying vote to candidate 41deb06d810c4ae3a8b07fd7371e9eb8 for term 2 because replica has last-logged OpId of term: 1 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260806 02:17:50.397740 4437 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.189.188:41015
I20260806 02:17:50.397897 4438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:50.398003 4438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:50.398026 4604 leader_election.cc:302] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41deb06d810c4ae3a8b07fd7371e9eb8; no voters: 5c3fe87e80294bcd9b935119e4dec5f4, 90dfdcce2cef45bab3bdcc75a9f667de
I20260806 02:17:50.398252 4457 master.cc:537] Master@127.26.189.188:41015 shutting down...
I20260806 02:17:50.398386 4688 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:17:50.403028 4434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.396965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:42455 (local address 127.0.0.1:38106)
0806 02:17:50.397071 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.397088 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.397165 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.398850 (+ 1685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.398856 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.398880 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:50.399002 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.399009 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.400087 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.400091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.401374 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.401388 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.402589 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.402592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.402706 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.402753 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.402826 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.402898 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260806 02:17:50.403661 4686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.397071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38106 (local address 127.26.189.189:42455)
0806 02:17:50.398584 (+ 1513us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.398588 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.398604 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:17:50.398648 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.398651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.398709 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.398816 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:50.399138 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.399953 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.401577 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.402268 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.402386 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.402525 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.403446 (+ 921us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.403523 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1428}
I20260806 02:17:50.403707 4643 raft_consensus.cc:858] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } }
W20260806 02:17:50.403826 4643 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } }
I20260806 02:17:50.404230 4508 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 LEARNER]: Refusing update from remote peer 90dfdcce2cef45bab3bdcc75a9f667de: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 02:17:50.404690 4438 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 02:17:50.405362 4643 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5c3fe87e80294bcd9b935119e4dec5f4 (127.26.189.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } }
I20260806 02:17:50.406454 4508 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 41deb06d810c4ae3a8b07fd7371e9eb8 (127.26.189.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:50.407398 4688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90dfdcce2cef45bab3bdcc75a9f667de. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } }
I20260806 02:17:50.407497 4688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260806 02:17:50.407614 4688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } }
I20260806 02:17:50.407678 4688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260806 02:17:50.407742 4688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } }
I20260806 02:17:50.407801 4688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260806 02:17:50.408768 4566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90dfdcce2cef45bab3bdcc75a9f667de. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:50.408900 4566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: This master's current role is: LEARNER
I20260806 02:17:50.408998 4566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: NON_VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: true } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:50.409085 4566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: This master's current role is: LEARNER
I20260806 02:17:50.410048 4437 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de: attempting to promote NON_VOTER 5c3fe87e80294bcd9b935119e4dec5f4 to VOTER
I20260806 02:17:50.410516 4437 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } }
I20260806 02:17:50.410677 4719 mvcc.cc:205] Tried to move back new op lower bound from 7315385011801878528 to 7315385011701940224. Current Snapshot: MvccSnapshot[applied={T|T < 7315385011736780800}]
I20260806 02:17:50.412478 4508 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 LEARNER]: Refusing update from remote peer 90dfdcce2cef45bab3bdcc75a9f667de: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 02:17:50.413210 4438 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260806 02:17:50.413349 3639 consensus_peers.cc:487] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de -> Peer 41deb06d810c4ae3a8b07fd7371e9eb8 (127.26.189.188:41015): Couldn't send request to peer 41deb06d810c4ae3a8b07fd7371e9eb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 02:17:50.415326 4437 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 5c3fe87e80294bcd9b935119e4dec5f4 (127.26.189.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:50.416566 4457 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260806 02:17:50.416846 4457 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260806 02:17:50.416957 4457 tablet_replica.cc:330] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: stopping tablet replica
I20260806 02:17:50.416987 4438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:50.417080 4438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:50.417274 4437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:50.417359 4437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:50.417724 4508 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 5c3fe87e80294bcd9b935119e4dec5f4 (127.26.189.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:50.419792 4727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:50.419911 4727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:17:50.423399 4457 master.cc:552] Master@127.26.189.188:41015 shutdown complete.
I20260806 02:17:50.423496 4457 master_runner.cc:305] Clearing existing system tablet
I20260806 02:17:50.423795 4457 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:50.423861 4457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:50.425918 4457 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260806 02:17:50.426913 4738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:50.427183 4457 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:50.427490 4457 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:50.427594 4457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/wal
uuid: "41deb06d810c4ae3a8b07fd7371e9eb8"
format_stamp: "Formatted at 2026-08-06 02:17:50 on dist-test-slave-gkw7"
server_key: "966d9786a38bdb28ffa60159eb70385e"
server_key_iv: "bdc5cabbfec9fc4a483bee1f24fe4c94"
server_key_version: "encryptionkey@0"
I20260806 02:17:50.429674 4457 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:50.432440 4457 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 02:17:50.432626 4457 log.cc:1196] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 02:17:50.433023 4457 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: Deleting consensus metadata
I20260806 02:17:50.433264 4457 master_runner.cc:315] Copying system tablet from 127.26.189.190:40257
I20260806 02:17:50.434644 4457 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: tablet copy: Beginning tablet copy session from remote peer at address 127.26.189.190:40257
I20260806 02:17:50.440037 4112 heartbeater.cc:503] Master 127.26.189.190:40257 was elected leader, sending a full tablet report...
I20260806 02:17:50.445410 4746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.435304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:60718)
0806 02:17:50.435623 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.435641 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.435781 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.436071 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.436074 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.436303 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.436436 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.436443 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.437660 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.437664 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.438561 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.438572 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.439211 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.439215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.439312 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.440439 (+ 1127us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.440456 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.440978 (+ 522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.443475 (+ 2497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.443478 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.443481 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.443761 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.444194 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.444197 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.444199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.444296 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.444798 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.444801 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.444913 (+ 112us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.445027 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.445193 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":89,"threads_started":1}
I20260806 02:17:50.445421 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.435415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60718 (local address 127.26.189.190:40257)
0806 02:17:50.435559 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.435565 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.435754 (+ 189us) server_negotiation.cc:407] Connection header received
0806 02:17:50.435872 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.435875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.435929 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.436037 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.436572 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.437480 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.438694 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.439076 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.439191 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.441142 (+ 1951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.441146 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.441149 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.441177 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.443340 (+ 2163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.443964 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.443969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.443971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.444079 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.444405 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.444409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.444411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.444682 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.444790 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.445116 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.445248 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:17:50.446342 3690 tablet_copy_service.cc:140] P 90dfdcce2cef45bab3bdcc75a9f667de: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 41deb06d810c4ae3a8b07fd7371e9eb8 ({username='oryx', principal='oryx/127.26.189.188@KRBTEST.COM'} at 127.0.0.1:60718)
I20260806 02:17:50.446463 3690 tablet_copy_service.cc:161] P 90dfdcce2cef45bab3bdcc75a9f667de: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 41deb06d810c4ae3a8b07fd7371e9eb8 at {username='oryx', principal='oryx/127.26.189.188@KRBTEST.COM'} at 127.0.0.1:60718: session id = 41deb06d810c4ae3a8b07fd7371e9eb8-00000000000000000000000000000000
I20260806 02:17:50.447558 3690 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 02:17:50.448930 4457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 02:17:50.451740 4457 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: tablet copy: Starting download of 0 data blocks...
I20260806 02:17:50.452031 4457 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: tablet copy: Starting download of 1 WAL segments...
I20260806 02:17:50.453804 4457 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 02:17:50.455823 3690 tablet_copy_service.cc:342] P 90dfdcce2cef45bab3bdcc75a9f667de: Request end of tablet copy session 41deb06d810c4ae3a8b07fd7371e9eb8-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.189.188@KRBTEST.COM'} at 127.0.0.1:60718
I20260806 02:17:50.455909 3690 tablet_copy_service.cc:433] P 90dfdcce2cef45bab3bdcc75a9f667de: ending tablet copy session 41deb06d810c4ae3a8b07fd7371e9eb8-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 41deb06d810c4ae3a8b07fd7371e9eb8
I20260806 02:17:50.464295 4457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:50.466234 4748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:50.466208 4747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:50.466529 4753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:50.466820 4457 server_base.cc:1034] running on GCE node
I20260806 02:17:50.467108 4457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:50.467471 4457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:50.468683 4457 hybrid_clock.cc:648] HybridClock initialized: now 1785982670468664 us; error 35 us; skew 500 ppm
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:50.470503 4457 init.cc:377] Logged in from keytab as oryx/127.26.189.188@KRBTEST.COM (short username oryx)
I20260806 02:17:50.471046 4457 webserver.cc:460] Webserver started at http://127.26.189.188:45317/ using document root <none> and password file <none>
I20260806 02:17:50.471311 4457 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:50.471408 4457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:50.472882 4457 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 02:17:50.474190 4761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:50.474539 4457 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 02:17:50.474614 4457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/wal
uuid: "41deb06d810c4ae3a8b07fd7371e9eb8"
format_stamp: "Formatted at 2026-08-06 02:17:50 on dist-test-slave-gkw7"
server_key: "966d9786a38bdb28ffa60159eb70385e"
server_key_iv: "bdc5cabbfec9fc4a483bee1f24fe4c94"
server_key_version: "encryptionkey@0"
I20260806 02:17:50.474707 4457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:50.503252 4457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:50.505698 4457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:50.510948 4457 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.188:41015
I20260806 02:17:50.511085 4825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.188:41015 every 8 connection(s)
I20260806 02:17:50.511562 4457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
I20260806 02:17:50.513566 4826 sys_catalog.cc:263] Verifying existing consensus state
I20260806 02:17:50.514882 4826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: Bootstrap starting.
I20260806 02:17:50.524915 4826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 02:17:50.525257 4826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: Bootstrap complete.
I20260806 02:17:50.525916 4826 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } }
I20260806 02:17:50.526129 4826 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 41deb06d810c4ae3a8b07fd7371e9eb8, State: Initialized, Role: LEARNER
I20260806 02:17:50.526305 4826 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } }
I20260806 02:17:50.526695 4831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:50.526844 4826 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:50.526891 4831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: This master's current role is: LEARNER
I20260806 02:17:50.532070 4852 catalog_manager.cc:1259] Loaded cluster ID: bd474ef98e13448cbeaaf9c45a767a4d
I20260806 02:17:50.532141 4852 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: loading cluster ID for follower catalog manager: success
I20260806 02:17:50.534373 4852 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: acquiring CA information for follower catalog manager: success
I20260806 02:17:50.535862 4852 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 02:17:50.539948 4718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:50.540184 4718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:50.540270 4718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:50.544416 4718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:50.544471 4718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:50.544565 4718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:50.549950 4718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:44885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab
--principal=oryx/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:38345
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=42557
--tserver_master_addrs=127.26.189.190:40257,127.26.189.189:42455,127.26.189.188:41015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:50.551079 4718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:50.552155 4718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:50.562340 4862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:50.562397 4718 server_base.cc:1034] running on GCE node
W20260806 02:17:50.562345 4860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:50.562345 4859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:50.562970 4718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:50.563616 4718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:50.564779 4718 hybrid_clock.cc:648] HybridClock initialized: now 1785982670564744 us; error 47 us; skew 500 ppm
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:50.567698 4718 init.cc:377] Logged in from keytab as oryx/127.26.189.129@KRBTEST.COM (short username oryx)
I20260806 02:17:50.568537 4718 webserver.cc:460] Webserver started at http://127.26.189.129:42557/ using document root <none> and password file <none>
I20260806 02:17:50.569065 4718 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:50.569139 4718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:50.573151 4718 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:17:50.575603 4871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:50.577088 4718 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:17:50.577263 4718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "a1213b43a4bb4c86bd8fcbb05379fb59"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "89829d2b39755ff532c3739b0ea7e2f9"
server_key_iv: "c293b4a26d0f86cc26f593793944bc19"
server_key_version: "encryptionkey@0"
I20260806 02:17:50.577910 4718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:50.596056 4718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:50.599488 4718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:50.599712 4718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:50.600332 4718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:50.601214 4718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:50.601289 4718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:50.601359 4718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:50.601413 4718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:50.610543 4718 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:38345
I20260806 02:17:50.610608 5022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:38345 every 8 connection(s)
I20260806 02:17:50.611599 4718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:50.617024 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 4718
I20260806 02:17:50.617226 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 3939
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.188@KRBTEST.COM
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:50.630453 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.614550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:41567 (local address 127.26.189.190:40257)
0806 02:17:50.614699 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.614703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.614719 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:17:50.615896 (+ 1177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.615899 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.615963 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.616044 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.619659 (+ 3615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.620723 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.622367 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.622849 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.622964 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.626316 (+ 3352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.626325 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.626331 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.626374 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.628008 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.628576 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.628582 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.628586 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.628667 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.629040 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.629046 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.629050 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.629297 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.629374 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.630060 (+ 686us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.630218 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 02:17:50.631933 5029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.613862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.129:41567)
0806 02:17:50.614520 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.614577 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.615659 (+ 1082us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.616256 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.616265 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.616806 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.619471 (+ 2665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.619485 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.620897 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.620903 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.622176 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.622203 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.623176 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.623195 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.623350 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.624328 (+ 978us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.624351 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.626123 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.628137 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.628142 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.628147 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.628473 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.628764 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.628766 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.628768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.628939 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.629438 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.629446 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.629787 (+ 341us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.630828 (+ 1041us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.631128 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"mutex_wait_us":135,"spinlock_wait_cycles":12672,"thread_start_us":743,"threads_started":1}
I20260806 02:17:50.632580 5027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.613461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:48569 (local address 127.26.189.188:41015)
0806 02:17:50.614347 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.614353 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.615207 (+ 854us) server_negotiation.cc:407] Connection header received
0806 02:17:50.616039 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.616043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.616102 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.616205 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.618063 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.618897 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.620244 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.620514 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.620587 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.624463 (+ 3876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.624469 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.624475 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.624505 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.627661 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.628646 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.628653 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.628658 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.628780 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.629227 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.629234 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.629238 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.629599 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.629707 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.632089 (+ 2382us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.632299 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":779,"thread_start_us":102,"threads_started":1}
I20260806 02:17:50.631942 5031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.613863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:41015 (local address 127.26.189.129:48569)
0806 02:17:50.615093 (+ 1230us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.615106 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.615659 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.616283 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.616285 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.616810 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.617916 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.617932 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.619052 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.619055 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.620121 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.620130 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.620771 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.620774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.620943 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.622085 (+ 1142us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.622109 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.624280 (+ 2171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.627830 (+ 3550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.627840 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.627865 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.628491 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.628933 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.628939 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.628944 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.629068 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.629784 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.629790 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.629928 (+ 138us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.630093 (+ 165us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.630599 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1155,"mutex_wait_us":597,"spinlock_wait_cycles":11136,"thread_start_us":154,"threads_started":1}
I20260806 02:17:50.634332 5023 heartbeater.cc:347] Connected to a master server at 127.26.189.188:41015
I20260806 02:17:50.634667 5023 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:50.635525 5023 heartbeater.cc:511] Master 127.26.189.188:41015 requested a full tablet report, sending...
I20260806 02:17:50.637795 4785 ts_manager.cc:194] Registered new tserver with Master: a1213b43a4bb4c86bd8fcbb05379fb59 (127.26.189.129:38345)
I20260806 02:17:50.643676 5024 heartbeater.cc:347] Connected to a master server at 127.26.189.190:40257
I20260806 02:17:50.643790 5024 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:50.644004 5024 heartbeater.cc:511] Master 127.26.189.190:40257 requested a full tablet report, sending...
I20260806 02:17:50.644937 3663 ts_manager.cc:194] Re-registered known tserver with Master: a1213b43a4bb4c86bd8fcbb05379fb59 (127.26.189.129:38345)
I20260806 02:17:50.645805 3663 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:41567
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.189@KRBTEST.COM
I20260806 02:17:50.650431 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:44587
--local_ip_for_outbound_sockets=127.26.189.130
--tserver_master_addrs=127.26.189.190:40257
--webserver_port=35161
--webserver_interface=127.26.189.130
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab
--principal=oryx/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:44885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.189.190:40257,127.26.189.189:42455
--tserver_master_addrs=127.26.189.190:40257,127.26.189.189:42455,127.26.189.188:41015 with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:17:50.650872 4686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.614077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:43503 (local address 127.26.189.189:42455)
0806 02:17:50.614233 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.614238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.615455 (+ 1217us) server_negotiation.cc:407] Connection header received
0806 02:17:50.616274 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.616277 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.616336 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.616431 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.642334 (+ 25903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.643159 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.644536 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.644847 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.644937 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.647581 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.647585 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.647588 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.647622 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.649123 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.649610 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.649613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.649615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.649701 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.650003 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.650006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.650008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.650196 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.650310 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.650588 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.650708 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:17:50.650902 5030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.613863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:42455 (local address 127.26.189.129:43503)
0806 02:17:50.615352 (+ 1489us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.615365 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.615676 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.616466 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.616469 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.616856 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.642145 (+ 25289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.642162 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.643354 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.643357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.644385 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.644397 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.645145 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.645148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.645236 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.645912 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.645928 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.647416 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.649247 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.649253 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.649255 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.649466 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.649801 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.649805 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.649807 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.649899 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.650299 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.650302 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.650402 (+ 100us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.650511 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.650697 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1409,"mutex_wait_us":948,"spinlock_wait_cycles":12160,"thread_start_us":129,"threads_started":1}
I20260806 02:17:50.651913 5025 heartbeater.cc:347] Connected to a master server at 127.26.189.189:42455
I20260806 02:17:50.652036 5025 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:50.652273 5025 heartbeater.cc:511] Master 127.26.189.189:42455 requested a full tablet report, sending...
I20260806 02:17:50.653620 4507 ts_manager.cc:194] Registered new tserver with Master: a1213b43a4bb4c86bd8fcbb05379fb59 (127.26.189.129:38345)
I20260806 02:17:50.674387 4304 heartbeater.cc:503] Master 127.26.189.190:40257 was elected leader, sending a full tablet report...
W20260806 02:17:50.767097 5032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:50.767412 5032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:50.767493 5032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:50.771548 5032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:50.771644 5032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:50.771734 5032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:50.777369 5032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:44885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab
--principal=oryx/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:44587
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=35161
--tserver_master_addrs=127.26.189.190:40257,127.26.189.189:42455,127.26.189.188:41015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:50.778498 5032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:50.779598 5032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:50.790491 5039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:50.790481 5037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:50.790571 5032 server_base.cc:1034] running on GCE node
W20260806 02:17:50.790481 5044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:50.791077 5032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:50.791807 5032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:50.793004 5032 hybrid_clock.cc:648] HybridClock initialized: now 1785982670792971 us; error 49 us; skew 500 ppm
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:50.795912 5032 init.cc:377] Logged in from keytab as oryx/127.26.189.130@KRBTEST.COM (short username oryx)
I20260806 02:17:50.796844 5032 webserver.cc:460] Webserver started at http://127.26.189.130:35161/ using document root <none> and password file <none>
I20260806 02:17:50.797449 5032 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:50.797593 5032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:50.801460 5032 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 02:17:50.803741 5053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:50.804970 5032 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 02:17:50.805119 5032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "ba92d15617ab488b859f55bff4b37804"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "0cf11c091d8627b6aeb36b99d286043c"
server_key_iv: "4ee740ec9b2c3ab8ad45f22b07849b08"
server_key_version: "encryptionkey@0"
I20260806 02:17:50.805733 5032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:50.827517 5032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:50.830868 5032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:50.831085 5032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:50.831756 5032 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:50.832710 5032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:50.832784 5032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:50.832851 5032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:50.832902 5032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:50.841895 5032 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:44587
I20260806 02:17:50.841955 5197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:44587 every 8 connection(s)
I20260806 02:17:50.842957 5032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:50.848882 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 5032
I20260806 02:17:50.849073 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 4120
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:50.865940 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.844824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:56429 (local address 127.26.189.190:40257)
0806 02:17:50.844960 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.844965 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.846760 (+ 1795us) server_negotiation.cc:407] Connection header received
0806 02:17:50.847368 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.847372 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.847429 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.847544 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.854880 (+ 7336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.855739 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.857497 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.857850 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.857925 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.861309 (+ 3384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.861313 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.861316 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.861343 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.863177 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.863871 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.863878 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.863882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.863976 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.864428 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.864432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.864433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.864653 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.864739 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.865507 (+ 768us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.865692 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:17:50.866952 5209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.845329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.130:56429)
0806 02:17:50.846651 (+ 1322us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.846663 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.847193 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.847737 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.847740 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.853934 (+ 6194us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.854677 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.854698 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.855904 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.855906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.857356 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.857367 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.858139 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.858142 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.858356 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.859070 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.859091 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.861098 (+ 2007us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.863321 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.863331 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.863352 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.863738 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.864102 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.864105 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.864107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.864320 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.864827 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.864834 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.865159 (+ 325us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.865398 (+ 239us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.865813 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1125,"mutex_wait_us":49,"spinlock_wait_cycles":19200,"thread_start_us":192,"threads_started":1}
I20260806 02:17:50.868733 5200 heartbeater.cc:347] Connected to a master server at 127.26.189.190:40257
I20260806 02:17:50.868988 5200 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:50.869604 5200 heartbeater.cc:511] Master 127.26.189.190:40257 requested a full tablet report, sending...
I20260806 02:17:50.870883 3663 ts_manager.cc:194] Re-registered known tserver with Master: ba92d15617ab488b859f55bff4b37804 (127.26.189.130:44587)
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.189@KRBTEST.COM
Aug 06 02:17:50 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982670, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.188@KRBTEST.COM
I20260806 02:17:50.871707 3663 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:56429
I20260806 02:17:50.872208 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:34487
--local_ip_for_outbound_sockets=127.26.189.131
--tserver_master_addrs=127.26.189.190:40257
--webserver_port=33809
--webserver_interface=127.26.189.131
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab
--principal=oryx/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:44885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.189.190:40257,127.26.189.189:42455
--tserver_master_addrs=127.26.189.190:40257,127.26.189.189:42455,127.26.189.188:41015 with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:17:50.876524 5027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.846501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:46143 (local address 127.26.189.188:41015)
0806 02:17:50.846616 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.846620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.847700 (+ 1080us) server_negotiation.cc:407] Connection header received
0806 02:17:50.847787 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.847790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.847841 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.847930 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.866370 (+ 18440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.867308 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.868787 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.869257 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.869359 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.872254 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.872260 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.872266 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.872296 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.874218 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.874773 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.874776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.874779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.874891 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.875418 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.875424 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.875428 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.875690 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.875799 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.876201 (+ 402us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.876349 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 02:17:50.876852 5208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.845843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:41015 (local address 127.26.189.130:46143)
0806 02:17:50.847599 (+ 1756us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.847613 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.847706 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.847967 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.847970 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.863602 (+ 15632us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.863746 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.863752 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.867481 (+ 3729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.867486 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.868619 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.868634 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.869598 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.869604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.869721 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.870231 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.870251 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.872111 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.874344 (+ 2233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.874350 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.874355 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.874644 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.875009 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.875014 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.875018 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.875276 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.875853 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.875858 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.875961 (+ 103us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.876096 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.876239 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1694,"mutex_wait_us":75,"thread_start_us":88,"threads_started":1}
I20260806 02:17:50.877043 4686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.844817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:58585 (local address 127.26.189.189:42455)
0806 02:17:50.844960 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.844965 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.846503 (+ 1538us) server_negotiation.cc:407] Connection header received
0806 02:17:50.847390 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.847394 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.847457 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.847541 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:50.864279 (+ 16738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.865053 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.866501 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.866825 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.866903 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.872180 (+ 5277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:50.872183 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:50.872186 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:50.872218 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:50.875071 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.875637 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.875641 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.875643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.875765 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:50.876051 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:50.876054 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:50.876056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:50.876291 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:50.876407 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.876776 (+ 369us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.876886 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 02:17:50.877597 5207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.845329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:42455 (local address 127.26.189.130:58585)
0806 02:17:50.846296 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.846354 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.847180 (+ 826us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.847726 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.847738 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.863945 (+ 16207us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:50.864104 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.864111 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.865198 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.865201 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.866356 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.866366 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.867653 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.867656 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.867791 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.868352 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:50.868368 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:50.872003 (+ 3635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:50.875168 (+ 3165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.875174 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.875176 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.875532 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.875846 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:50.875851 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:50.875852 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:50.875943 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:50.876454 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:50.876457 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:50.876546 (+ 89us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.877193 (+ 647us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.877360 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"mutex_wait_us":1,"thread_start_us":175,"threads_started":1}
I20260806 02:17:50.877768 5199 heartbeater.cc:347] Connected to a master server at 127.26.189.188:41015
I20260806 02:17:50.877859 5199 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:50.878077 5199 heartbeater.cc:511] Master 127.26.189.188:41015 requested a full tablet report, sending...
I20260806 02:17:50.878788 5203 heartbeater.cc:347] Connected to a master server at 127.26.189.189:42455
I20260806 02:17:50.878881 5203 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:50.879037 5203 heartbeater.cc:511] Master 127.26.189.189:42455 requested a full tablet report, sending...
I20260806 02:17:50.879053 4785 ts_manager.cc:194] Registered new tserver with Master: ba92d15617ab488b859f55bff4b37804 (127.26.189.130:44587)
I20260806 02:17:50.879761 4507 ts_manager.cc:194] Registered new tserver with Master: ba92d15617ab488b859f55bff4b37804 (127.26.189.130:44587)
I20260806 02:17:50.917371 5211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.913671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:41015 (local address 127.0.0.1:46540)
0806 02:17:50.913942 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:50.913960 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:50.914118 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:50.914441 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:50.914443 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:50.914461 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:50.914577 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.914595 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.915375 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.915379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.916216 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:50.916225 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.916949 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.916952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:50.917047 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.917070 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 02:17:50.917132 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 02:17:50.917224 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":92,"threads_started":1}
I20260806 02:17:50.917371 5027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:50.913777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46540 (local address 127.26.189.188:41015)
0806 02:17:50.913942 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:50.913948 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:50.914051 (+ 103us) server_negotiation.cc:407] Connection header received
0806 02:17:50.914241 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:50.914245 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:50.914311 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:50.914413 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:50.914698 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.915251 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.916349 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:50.916809 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:50.916948 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:50.917109 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:50.917161 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 02:17:50.917225 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 02:17:50.918285 4796 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260806 02:17:50.918603 4831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90dfdcce2cef45bab3bdcc75a9f667de. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:50.918764 4831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: This master's current role is: LEARNER
W20260806 02:17:50.994984 5210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:50.995263 5210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:50.995307 5210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:50.999473 5210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:50.999534 5210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:50.999593 5210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:51.004935 5210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:44885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab
--principal=oryx/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:34487
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=33809
--tserver_master_addrs=127.26.189.190:40257,127.26.189.189:42455,127.26.189.188:41015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:51.006170 5210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:51.007280 5210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:51.018100 5224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:51.018100 5217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:51.018143 5219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:51.018522 5210 server_base.cc:1034] running on GCE node
I20260806 02:17:51.018924 5210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:51.019662 5210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:51.020839 5210 hybrid_clock.cc:648] HybridClock initialized: now 1785982671020793 us; error 64 us; skew 500 ppm
Aug 06 02:17:51 dist-test-slave-gkw7 krb5kdc[3602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982671, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:51.023952 5210 init.cc:377] Logged in from keytab as oryx/127.26.189.131@KRBTEST.COM (short username oryx)
I20260806 02:17:51.024932 5210 webserver.cc:460] Webserver started at http://127.26.189.131:33809/ using document root <none> and password file <none>
I20260806 02:17:51.025606 5210 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:51.025691 5210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:51.030140 5210 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 02:17:51.032534 5234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:51.033937 5210 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:51.034066 5210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "07dd0041edd843e7a3b6b9ae5dfeef74"
format_stamp: "Formatted at 2026-08-06 02:17:49 on dist-test-slave-gkw7"
server_key: "3dc11a7b06e5c6f67fbb045d213c2b42"
server_key_iv: "613b5833ea39ad8db572deb24d90093c"
server_key_version: "encryptionkey@0"
I20260806 02:17:51.034623 5210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:51.059360 5210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:51.062955 5210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:51.063167 5210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:51.063844 5210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:17:51.064771 5210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:51.064848 5210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:51.064917 5210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:51.064970 5210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:51.075453 5210 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:34487
I20260806 02:17:51.075474 5390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:34487 every 8 connection(s)
I20260806 02:17:51.076606 5210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:51.083534 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 5210
Aug 06 02:17:51 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982671, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.188@KRBTEST.COM
Aug 06 02:17:51 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982671, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
Aug 06 02:17:51 dist-test-slave-gkw7 krb5kdc[3602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982671, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.189@KRBTEST.COM
I20260806 02:17:51.097164 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.079257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:59859 (local address 127.26.189.190:40257)
0806 02:17:51.079384 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.079389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.081878 (+ 2489us) server_negotiation.cc:407] Connection header received
0806 02:17:51.082074 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.082077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.082134 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.082189 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:51.084004 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.084848 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.086822 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.087178 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.087252 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.092938 (+ 5686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:51.092942 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:51.092944 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:51.092970 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:51.094948 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.095733 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.095740 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.095745 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.095847 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.096186 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.096190 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.096191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.096411 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:51.096493 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.096854 (+ 361us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.096995 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 02:17:51.097180 5027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.080259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:33293 (local address 127.26.189.188:41015)
0806 02:17:51.080400 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.080404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.080499 (+ 95us) server_negotiation.cc:407] Connection header received
0806 02:17:51.081777 (+ 1278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.081783 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.081872 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.081955 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:51.084003 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.084840 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.086821 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.087171 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.087258 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.092062 (+ 4804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:51.092069 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:51.092073 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:51.092100 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:51.094355 (+ 2255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.095039 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.095046 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.095049 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.095141 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.095608 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.095611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.095613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.095877 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:51.095961 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.096858 (+ 897us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.096988 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:17:51.097759 4686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.079255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:52599 (local address 127.26.189.189:42455)
0806 02:17:51.079384 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.079389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.082112 (+ 2723us) server_negotiation.cc:407] Connection header received
0806 02:17:51.082305 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.082308 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.082355 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.082405 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:51.084012 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.084816 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.086797 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.087139 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.087214 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.092914 (+ 5700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:51.092921 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:51.092924 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:51.092958 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:51.095636 (+ 2678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.096400 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.096404 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.096406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.096493 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.096807 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.096811 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.096813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.097021 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:51.097102 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.097449 (+ 347us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.097597 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 02:17:51.099498 5400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.079040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:42455 (local address 127.26.189.131:52599)
0806 02:17:51.082031 (+ 2991us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:51.082043 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:51.082173 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:51.082545 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:51.082547 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:51.082999 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:51.083815 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.083837 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.085011 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.085014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.086659 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.086669 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.087417 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.087420 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.087715 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.088622 (+ 907us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:51.088663 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:51.092750 (+ 4087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:51.096028 (+ 3278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:51.096032 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:51.096034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:51.096281 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:51.096604 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:51.096606 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:51.096608 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:51.096686 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:51.097161 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:51.097164 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:51.097253 (+ 89us) client_negotiation.cc:769] Sending connection context
0806 02:17:51.097966 (+ 713us) client_negotiation.cc:240] Negotiation successful
0806 02:17:51.098121 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2898,"mutex_wait_us":676,"spinlock_wait_cycles":20096,"thread_start_us":114,"threads_started":1}
I20260806 02:17:51.100107 5402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.079040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.131:59859)
0806 02:17:51.081760 (+ 2720us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:51.081776 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:51.081955 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:51.082331 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:51.082334 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:51.082983 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:51.083823 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.083838 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.085014 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.085017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.086675 (+ 1658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.086686 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.087421 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.087424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.087733 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.088799 (+ 1066us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:51.088817 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:51.091535 (+ 2718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:51.095064 (+ 3529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:51.095067 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:51.095069 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:51.095596 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:51.095964 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:51.095966 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:51.095968 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:51.096069 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:51.096553 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:51.096556 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:51.096654 (+ 98us) client_negotiation.cc:769] Sending connection context
0806 02:17:51.097419 (+ 765us) client_negotiation.cc:240] Negotiation successful
0806 02:17:51.097891 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2583,"mutex_wait_us":507,"spinlock_wait_cycles":90624,"thread_start_us":171,"threads_started":1}
I20260806 02:17:51.100108 5401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.079040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:41015 (local address 127.26.189.131:33293)
0806 02:17:51.080343 (+ 1303us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:51.080401 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:51.081476 (+ 1075us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:51.082300 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:51.082313 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:51.082984 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:51.083820 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.083838 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.085014 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.085017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.086675 (+ 1658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.086686 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.087421 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.087424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.087708 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.088655 (+ 947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:51.088672 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:51.091891 (+ 3219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:51.094482 (+ 2591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:51.094491 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:51.094513 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:51.094910 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:51.095278 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:51.095281 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:51.095283 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:51.095482 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:51.096150 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:51.096157 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:51.096549 (+ 392us) client_negotiation.cc:769] Sending connection context
0806 02:17:51.097417 (+ 868us) client_negotiation.cc:240] Negotiation successful
0806 02:17:51.098235 (+ 818us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1101,"mutex_wait_us":778,"spinlock_wait_cycles":16384,"thread_start_us":713,"threads_started":1}
I20260806 02:17:51.101037 5394 heartbeater.cc:347] Connected to a master server at 127.26.189.190:40257
I20260806 02:17:51.101361 5394 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:51.101364 5392 heartbeater.cc:347] Connected to a master server at 127.26.189.188:41015
I20260806 02:17:51.101495 5392 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:51.101914 5397 heartbeater.cc:347] Connected to a master server at 127.26.189.189:42455
I20260806 02:17:51.101994 5397 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:51.102090 5392 heartbeater.cc:511] Master 127.26.189.188:41015 requested a full tablet report, sending...
I20260806 02:17:51.102133 5397 heartbeater.cc:511] Master 127.26.189.189:42455 requested a full tablet report, sending...
I20260806 02:17:51.102742 5394 heartbeater.cc:511] Master 127.26.189.190:40257 requested a full tablet report, sending...
I20260806 02:17:51.103677 4785 ts_manager.cc:194] Registered new tserver with Master: 07dd0041edd843e7a3b6b9ae5dfeef74 (127.26.189.131:34487)
I20260806 02:17:51.103957 4507 ts_manager.cc:194] Registered new tserver with Master: 07dd0041edd843e7a3b6b9ae5dfeef74 (127.26.189.131:34487)
I20260806 02:17:51.104099 3663 ts_manager.cc:194] Re-registered known tserver with Master: 07dd0041edd843e7a3b6b9ae5dfeef74 (127.26.189.131:34487)
I20260806 02:17:51.104707 5413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.090696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46546 (local address 127.26.189.188:41015)
0806 02:17:51.091042 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.091046 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.091277 (+ 231us) server_negotiation.cc:407] Connection header received
0806 02:17:51.091464 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.091468 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.091517 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.091657 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:51.093290 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.094213 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.096936 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.097780 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.097891 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.100005 (+ 2114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:51.100012 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:51.100015 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:51.100042 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:51.102000 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.102516 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.102520 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.102522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.102607 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.102954 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.102960 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.102962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.103201 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:51.103317 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.104411 (+ 1094us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.104544 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":106,"threads_started":1}
I20260806 02:17:51.104833 3663 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:59859
I20260806 02:17:51.110064 5415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.091255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38118 (local address 127.26.189.189:42455)
0806 02:17:51.092989 (+ 1734us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.092994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.093008 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:17:51.093048 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.093053 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.093101 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.093212 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:51.094948 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.095689 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.099214 (+ 3525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.099552 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.099654 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.106176 (+ 6522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:51.106180 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:51.106183 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:51.106210 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:51.108036 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.108560 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.108563 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.108565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.108661 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.109024 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.109027 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.109029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.109221 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:51.109367 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.109708 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.109854 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1656,"thread_start_us":96,"threads_started":1}
I20260806 02:17:51.111017 5408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.090009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60730 (local address 127.26.189.190:40257)
0806 02:17:51.090279 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.090284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.090518 (+ 234us) server_negotiation.cc:407] Connection header received
0806 02:17:51.090701 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.090704 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.090759 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.090845 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:51.098791 (+ 7946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.099556 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.102680 (+ 3124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.103012 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.103125 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.107076 (+ 3951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:51.107080 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:51.107082 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:51.107107 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:51.108789 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.109387 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.109391 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.109393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.109484 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.109821 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.109826 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.109828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.110109 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:51.110264 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.110575 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.110727 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":118,"threads_started":1}
I20260806 02:17:51.114133 3663 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60730:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:17:51.117386 3663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:51.120365 4736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: NON_VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: true } } }
I20260806 02:17:51.120533 4736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:51.122655 5422 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de: attempting to promote NON_VOTER 41deb06d810c4ae3a8b07fd7371e9eb8 to VOTER
I20260806 02:17:51.123031 5422 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } }
I20260806 02:17:51.124392 4796 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 LEARNER]: Refusing update from remote peer 90dfdcce2cef45bab3bdcc75a9f667de: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260806 02:17:51.124579 4520 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 FOLLOWER]: Refusing update from remote peer 90dfdcce2cef45bab3bdcc75a9f667de: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260806 02:17:51.124852 5420 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [LEADER]: Connected to new peer: Peer: permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260806 02:17:51.125006 5422 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260806 02:17:51.126981 4736 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 41deb06d810c4ae3a8b07fd7371e9eb8 (127.26.189.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } } }
I20260806 02:17:51.127396 4520 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 41deb06d810c4ae3a8b07fd7371e9eb8 (127.26.189.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } } }
I20260806 02:17:51.127827 4796 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 41deb06d810c4ae3a8b07fd7371e9eb8 (127.26.189.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } } }
I20260806 02:17:51.128625 4736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } } }
I20260806 02:17:51.128739 4736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:51.128891 4736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } } }
I20260806 02:17:51.128973 4736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:51.129341 5434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } } }
I20260806 02:17:51.129452 5434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:17:51.129707 4831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } } }
I20260806 02:17:51.129804 4831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:17:51.130507 5422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } } }
I20260806 02:17:51.130623 5422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:51.142521 5211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.136451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:34487 (local address 127.0.0.1:59022)
0806 02:17:51.136621 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:51.136635 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:51.136733 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:51.137446 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:51.137450 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:51.137469 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:51.137603 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.137611 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.139067 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.139072 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.140275 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.140286 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.142108 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.142112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.142195 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.142227 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 02:17:51.142299 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 02:17:51.142378 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"mutex_wait_us":21}
I20260806 02:17:51.142554 5440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.136633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59022 (local address 127.26.189.131:34487)
0806 02:17:51.136997 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.137010 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.137040 (+ 30us) server_negotiation.cc:407] Connection header received
0806 02:17:51.137111 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.137116 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.137303 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.137502 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:51.137845 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.138945 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.141144 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.141980 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.142125 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.142271 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.142337 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.142428 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":124,"threads_started":1}
I20260806 02:17:51.142995 5441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.136647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38345 (local address 127.0.0.1:39750)
0806 02:17:51.137175 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:51.137191 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:51.137289 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:51.139046 (+ 1757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:51.139049 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:51.139066 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:51.139190 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.139199 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.140401 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.140406 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.141335 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.141344 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.142614 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.142618 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.142706 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.142727 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 02:17:51.142797 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 02:17:51.142862 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"mutex_wait_us":2,"thread_start_us":110,"threads_started":1}
I20260806 02:17:51.143527 5442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.137407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39750 (local address 127.26.189.129:38345)
0806 02:17:51.138655 (+ 1248us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.138660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.138682 (+ 22us) server_negotiation.cc:407] Connection header received
0806 02:17:51.138750 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.138754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.138911 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.139079 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:51.139335 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.140293 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.141476 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.142312 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.142426 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.142551 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.143279 (+ 728us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.143389 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1144,"thread_start_us":112,"threads_started":1}
I20260806 02:17:51.143898 5439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.136927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:44587 (local address 127.0.0.1:45932)
0806 02:17:51.139335 (+ 2408us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:51.139349 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:51.139448 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:51.139923 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:51.139926 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:51.139945 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:51.140026 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.140031 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.141096 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.141099 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.142267 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.142279 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.143401 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.143405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.143513 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.143536 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 02:17:51.143709 (+ 173us) client_negotiation.cc:240] Negotiation successful
0806 02:17:51.143780 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2345,"thread_start_us":109,"threads_started":1}
I20260806 02:17:51.144469 5446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.137838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45932 (local address 127.26.189.130:44587)
0806 02:17:51.138169 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.138181 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.139441 (+ 1260us) server_negotiation.cc:407] Connection header received
0806 02:17:51.139559 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.139565 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.139771 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.139920 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:51.140146 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.140970 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.142421 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.143269 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.143391 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.143507 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.144233 (+ 726us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.144332 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":132,"threads_started":1}
I20260806 02:17:51.145933 5302 tablet_service.cc:1467] Processing CreateTablet for tablet bf7276f35bfa46caaee755576d58d098 (DEFAULT_TABLE table=test-table [id=68d79f1d19494683a9fc8e71c289b4a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:51.146286 4938 tablet_service.cc:1467] Processing CreateTablet for tablet bf7276f35bfa46caaee755576d58d098 (DEFAULT_TABLE table=test-table [id=68d79f1d19494683a9fc8e71c289b4a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:51.146872 5302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf7276f35bfa46caaee755576d58d098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:51.147320 4938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf7276f35bfa46caaee755576d58d098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:51.147130 5116 tablet_service.cc:1467] Processing CreateTablet for tablet bf7276f35bfa46caaee755576d58d098 (DEFAULT_TABLE table=test-table [id=68d79f1d19494683a9fc8e71c289b4a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:51.148088 5116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf7276f35bfa46caaee755576d58d098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:51.153795 5448 tablet_bootstrap.cc:492] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74: Bootstrap starting.
I20260806 02:17:51.155052 5449 tablet_bootstrap.cc:492] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59: Bootstrap starting.
I20260806 02:17:51.156579 5450 tablet_bootstrap.cc:492] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804: Bootstrap starting.
I20260806 02:17:51.156775 5448 tablet_bootstrap.cc:654] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:51.157299 5449 tablet_bootstrap.cc:654] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:51.157759 5448 log.cc:824] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:51.158598 5449 log.cc:824] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:51.158843 5450 tablet_bootstrap.cc:654] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:51.159595 5450 log.cc:824] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:51.160110 5448 tablet_bootstrap.cc:492] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74: No bootstrap required, opened a new log
I20260806 02:17:51.160328 5448 ts_tablet_manager.cc:1397] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260806 02:17:51.160499 5449 tablet_bootstrap.cc:492] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59: No bootstrap required, opened a new log
I20260806 02:17:51.160691 5449 ts_tablet_manager.cc:1397] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 02:17:51.161384 5450 tablet_bootstrap.cc:492] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804: No bootstrap required, opened a new log
I20260806 02:17:51.161599 5450 ts_tablet_manager.cc:1397] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260806 02:17:51.164665 5449 raft_consensus.cc:348] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } } peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } }
I20260806 02:17:51.164984 5449 raft_consensus.cc:374] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:51.165051 5449 raft_consensus.cc:729] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1213b43a4bb4c86bd8fcbb05379fb59, State: Initialized, Role: FOLLOWER
I20260806 02:17:51.164891 5448 raft_consensus.cc:348] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } } peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } }
I20260806 02:17:51.165117 5448 raft_consensus.cc:374] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:51.165165 5448 raft_consensus.cc:729] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07dd0041edd843e7a3b6b9ae5dfeef74, State: Initialized, Role: FOLLOWER
I20260806 02:17:51.165269 5450 raft_consensus.cc:348] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } } peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } }
I20260806 02:17:51.165540 5450 raft_consensus.cc:374] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:51.165522 5448 consensus_queue.cc:260] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } } peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } }
I20260806 02:17:51.165524 5449 consensus_queue.cc:260] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } } peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } }
I20260806 02:17:51.165643 5450 raft_consensus.cc:729] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba92d15617ab488b859f55bff4b37804, State: Initialized, Role: FOLLOWER
I20260806 02:17:51.166095 5450 consensus_queue.cc:260] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } } peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } }
I20260806 02:17:51.166185 5024 heartbeater.cc:503] Master 127.26.189.190:40257 was elected leader, sending a full tablet report...
I20260806 02:17:51.166543 5449 ts_tablet_manager.cc:1428] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260806 02:17:51.167034 5450 ts_tablet_manager.cc:1428] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 02:17:51.167855 5448 ts_tablet_manager.cc:1428] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 02:17:51.168074 5200 heartbeater.cc:503] Master 127.26.189.190:40257 was elected leader, sending a full tablet report...
I20260806 02:17:51.168917 5394 heartbeater.cc:503] Master 127.26.189.190:40257 was elected leader, sending a full tablet report...
W20260806 02:17:51.328882 5399 tablet.cc:2369] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 02:17:51.346397 5204 tablet.cc:2369] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 02:17:51.364814 5026 tablet.cc:2369] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:17:51.520678 5456 raft_consensus.cc:482] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:51.520912 5456 raft_consensus.cc:504] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } } peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } }
I20260806 02:17:51.522185 5456 leader_election.cc:288] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1213b43a4bb4c86bd8fcbb05379fb59 (127.26.189.129:38345), ba92d15617ab488b859f55bff4b37804 (127.26.189.130:44587)
I20260806 02:17:51.526116 5446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.522685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:45293 (local address 127.26.189.130:44587)
0806 02:17:51.522813 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.522820 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.522838 (+ 18us) server_negotiation.cc:407] Connection header received
0806 02:17:51.522899 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.522902 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.522954 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.523015 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:51.523366 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.523881 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.525015 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.525425 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.525594 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.525651 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.525890 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.525963 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 02:17:51.526116 5402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.522473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38345 (local address 127.26.189.131:52347)
0806 02:17:51.522683 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:51.522697 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:51.522793 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:51.523099 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:51.523102 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:51.523120 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:51.523235 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.523240 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.524000 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.524006 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.524892 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.524901 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.525578 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.525582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.525768 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.525786 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 02:17:51.525901 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 02:17:51.525966 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":146}
I20260806 02:17:51.526124 5442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.522561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:52347 (local address 127.26.189.129:38345)
0806 02:17:51.522682 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.522687 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.522772 (+ 85us) server_negotiation.cc:407] Connection header received
0806 02:17:51.522917 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.522919 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.522961 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.523057 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:51.523382 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.523878 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.525048 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.525423 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.525592 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.525651 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.525932 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.526022 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 02:17:51.526121 5401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.522455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:44587 (local address 127.26.189.131:45293)
0806 02:17:51.522623 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:51.522639 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:51.522740 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:51.523064 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:51.523067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:51.523092 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:51.523222 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.523228 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.524031 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.524033 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.524875 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:51.524883 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.525581 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.525585 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:51.525740 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.525769 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 02:17:51.525832 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 02:17:51.525941 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"mutex_wait_us":39}
I20260806 02:17:51.526830 5142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf7276f35bfa46caaee755576d58d098" candidate_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba92d15617ab488b859f55bff4b37804" is_pre_election: true
I20260806 02:17:51.526863 4961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf7276f35bfa46caaee755576d58d098" candidate_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" is_pre_election: true
I20260806 02:17:51.527202 4961 raft_consensus.cc:2454] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07dd0041edd843e7a3b6b9ae5dfeef74 in term 0.
I20260806 02:17:51.527204 5142 raft_consensus.cc:2454] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07dd0041edd843e7a3b6b9ae5dfeef74 in term 0.
I20260806 02:17:51.527750 5235 leader_election.cc:302] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 07dd0041edd843e7a3b6b9ae5dfeef74, a1213b43a4bb4c86bd8fcbb05379fb59, ba92d15617ab488b859f55bff4b37804; no voters:
I20260806 02:17:51.528115 5456 raft_consensus.cc:2781] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:51.528260 5456 raft_consensus.cc:482] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:51.528326 5456 raft_consensus.cc:3037] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:51.529572 5456 raft_consensus.cc:504] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } } peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } }
I20260806 02:17:51.529950 5456 leader_election.cc:288] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [CANDIDATE]: Term 1 election: Requested vote from peers a1213b43a4bb4c86bd8fcbb05379fb59 (127.26.189.129:38345), ba92d15617ab488b859f55bff4b37804 (127.26.189.130:44587)
I20260806 02:17:51.530362 4961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf7276f35bfa46caaee755576d58d098" candidate_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59"
I20260806 02:17:51.530362 5142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf7276f35bfa46caaee755576d58d098" candidate_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba92d15617ab488b859f55bff4b37804"
I20260806 02:17:51.530509 4961 raft_consensus.cc:3037] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:51.530496 5142 raft_consensus.cc:3037] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:51.531864 5142 raft_consensus.cc:2454] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07dd0041edd843e7a3b6b9ae5dfeef74 in term 1.
I20260806 02:17:51.531915 4961 raft_consensus.cc:2454] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07dd0041edd843e7a3b6b9ae5dfeef74 in term 1.
I20260806 02:17:51.532208 5239 leader_election.cc:302] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07dd0041edd843e7a3b6b9ae5dfeef74, ba92d15617ab488b859f55bff4b37804; no voters:
I20260806 02:17:51.532413 5456 raft_consensus.cc:2781] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:51.532616 5456 raft_consensus.cc:686] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 1 LEADER]: Becoming Leader. State: Replica: 07dd0041edd843e7a3b6b9ae5dfeef74, State: Running, Role: LEADER
I20260806 02:17:51.533021 5456 consensus_queue.cc:237] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } } peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } }
I20260806 02:17:51.536972 3663 catalog_manager.cc:5495] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07dd0041edd843e7a3b6b9ae5dfeef74 (127.26.189.131). New cstate: current_term: 1 leader_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } health_report { overall_health: UNKNOWN } } }
I20260806 02:17:51.593456 5440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.590016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59026 (local address 127.26.189.131:34487)
0806 02:17:51.590168 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.590173 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.590186 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:17:51.590267 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.590269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.590325 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.590417 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:51.590689 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.591237 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.592084 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.592315 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.592413 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.592690 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:51.593132 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:51.593230 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.593287 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.593340 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 02:17:51.599946 5142 raft_consensus.cc:1261] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804 [term 1 FOLLOWER]: Refusing update from remote peer 07dd0041edd843e7a3b6b9ae5dfeef74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:51.599946 4961 raft_consensus.cc:1261] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59 [term 1 FOLLOWER]: Refusing update from remote peer 07dd0041edd843e7a3b6b9ae5dfeef74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:51.600751 5456 consensus_queue.cc:1035] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:51.600975 5458 consensus_queue.cc:1035] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:51.611224 5467 mvcc.cc:205] Tried to move back new op lower bound from 7315385022865211392 to 7315385022602104832. Current Snapshot: MvccSnapshot[applied={T|T < 7315385022865211392}]
I20260806 02:17:51.627074 3665 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:51.627292 3665 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:51.634274 3665 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 90dfdcce2cef45bab3bdcc75a9f667de: Sending DeleteTablet for 3 replicas of tablet bf7276f35bfa46caaee755576d58d098
I20260806 02:17:51.635248 4938 tablet_service.cc:1514] Processing DeleteTablet for tablet bf7276f35bfa46caaee755576d58d098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:51 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:39750
I20260806 02:17:51.635366 5302 tablet_service.cc:1514] Processing DeleteTablet for tablet bf7276f35bfa46caaee755576d58d098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:51 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:59022
I20260806 02:17:51.635852 5478 tablet_replica.cc:330] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59: stopping tablet replica
I20260806 02:17:51.635854 5116 tablet_service.cc:1514] Processing DeleteTablet for tablet bf7276f35bfa46caaee755576d58d098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:51 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:45932
I20260806 02:17:51.636246 5478 raft_consensus.cc:2229] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:51.636416 5480 tablet_replica.cc:330] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804: stopping tablet replica
I20260806 02:17:51.636650 5478 raft_consensus.cc:2258] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:51.636853 5480 raft_consensus.cc:2229] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:51.637233 5480 raft_consensus.cc:2258] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:51.638891 5478 ts_tablet_manager.cc:1905] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:51.638947 5480 ts_tablet_manager.cc:1905] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:51.639034 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 3617
I20260806 02:17:51.643326 5480 ts_tablet_manager.cc:1918] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:51.643699 5480 log.cc:1196] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/bf7276f35bfa46caaee755576d58d098
I20260806 02:17:51.644095 5480 ts_tablet_manager.cc:1939] T bf7276f35bfa46caaee755576d58d098 P ba92d15617ab488b859f55bff4b37804: Deleting consensus metadata
I20260806 02:17:51.647511 5478 ts_tablet_manager.cc:1918] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:51.647667 5478 log.cc:1196] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-0/wal/wals/bf7276f35bfa46caaee755576d58d098
I20260806 02:17:51.647977 5478 ts_tablet_manager.cc:1939] T bf7276f35bfa46caaee755576d58d098 P a1213b43a4bb4c86bd8fcbb05379fb59: Deleting consensus metadata
I20260806 02:17:51.650564 5479 tablet_replica.cc:330] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74: stopping tablet replica
I20260806 02:17:51.651032 5479 raft_consensus.cc:2229] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:17:51.651600 5479 raft_consensus.cc:2258] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:51.653698 5479 ts_tablet_manager.cc:1905] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 02:17:51.654866 5061 connection.cc:535] server connection from 127.0.0.1:45932 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 02:17:51.655625 4877 connection.cc:535] server connection from 127.0.0.1:39750 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 02:17:51.657490 5479 ts_tablet_manager.cc:1918] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:51.657722 5479 log.cc:1196] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/bf7276f35bfa46caaee755576d58d098
I20260806 02:17:51.659809 5483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.637743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38120 (local address 127.26.189.189:42455)
0806 02:17:51.643623 (+ 5880us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.643628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.649914 (+ 6286us) server_negotiation.cc:407] Connection header received
0806 02:17:51.650093 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.650097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.650162 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.650254 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:51.651303 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.652122 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.653283 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.653669 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.653755 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.655733 (+ 1978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:51.655738 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:51.655741 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:51.655769 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:51.657784 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.658321 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.658325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.658327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.658429 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.658805 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.658812 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.658816 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.659071 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:51.659212 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.659489 (+ 277us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.659632 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5777,"thread_start_us":75,"threads_started":1}
I20260806 02:17:51.661677 5479 ts_tablet_manager.cc:1939] T bf7276f35bfa46caaee755576d58d098 P 07dd0041edd843e7a3b6b9ae5dfeef74: Deleting consensus metadata
W20260806 02:17:51.662992 5239 connection.cc:441] server connection from 127.0.0.1:59022 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59022 (request call id 1) could send its response
I20260806 02:17:51.669766 5482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.637365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46560 (local address 127.26.189.188:41015)
0806 02:17:51.650316 (+ 12951us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.650321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.659926 (+ 9605us) server_negotiation.cc:407] Connection header received
0806 02:17:51.660118 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.660122 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.660179 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.660242 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:51.661165 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.662063 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.663269 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.663646 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.663728 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.665894 (+ 2166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:51.665898 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:51.665901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:51.665927 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:51.667684 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.668161 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.668164 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.668166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.668249 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.668538 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.668541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.668543 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.668783 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:51.668886 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.669358 (+ 472us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.669510 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":12848,"thread_start_us":88,"threads_started":1}
I20260806 02:17:51.671155 5483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.660830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38126 (local address 127.26.189.189:42455)
0806 02:17:51.660925 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.660932 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.661069 (+ 137us) server_negotiation.cc:407] Connection header received
0806 02:17:51.661251 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.661254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.661299 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.661357 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:51.662381 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.663092 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.664288 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.664659 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.664756 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.667017 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:51.667024 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:51.667030 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:51.667059 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:51.669008 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.669817 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.669821 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.669823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.669909 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.670213 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.670217 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.670218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.670414 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:51.670524 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.670878 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.671004 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 02:17:51.675079 5490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:51.663593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46570 (local address 127.26.189.188:41015)
0806 02:17:51.664158 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:51.664162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:51.664642 (+ 480us) server_negotiation.cc:407] Connection header received
0806 02:17:51.664815 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:51.664819 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:51.664871 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:51.664932 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:51.666116 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.666951 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.668153 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:51.668560 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:51.668918 (+ 358us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:51.671066 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:51.671070 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:51.671072 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:51.671096 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:51.673250 (+ 2154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.673785 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.673790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.673792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.673880 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:51.674176 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:51.674180 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:51.674182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:51.674358 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:51.674498 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:51.674788 (+ 290us) server_negotiation.cc:299] Negotiation successful
0806 02:17:51.674930 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":259,"server-negotiator.queue_time_us":493,"thread_start_us":74,"threads_started":1}
I20260806 02:17:52.617425 5496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:52.616838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.130:37657)
0806 02:17:52.617176 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:52.617282 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":86,"threads_started":1}
I20260806 02:17:52.617712 5498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:52.617271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.131:37809)
0806 02:17:52.617513 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:52.617623 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":76,"threads_started":1}
W20260806 02:17:52.617813 5200 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:40257 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
W20260806 02:17:52.618314 5394 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:40257 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
I20260806 02:17:52.618774 5499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:52.617674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.129:46147)
0806 02:17:52.618583 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:52.618681 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":825,"thread_start_us":64,"threads_started":1}
W20260806 02:17:52.619038 5024 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:40257 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
I20260806 02:17:53.134037 5501 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90dfdcce2cef45bab3bdcc75a9f667de)
I20260806 02:17:53.134040 5502 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90dfdcce2cef45bab3bdcc75a9f667de)
I20260806 02:17:53.134294 5501 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } }
I20260806 02:17:53.134361 5502 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } }
I20260806 02:17:53.135056 5502 leader_election.cc:288] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 90dfdcce2cef45bab3bdcc75a9f667de (127.26.189.190:40257), 5c3fe87e80294bcd9b935119e4dec5f4 (127.26.189.189:42455)
I20260806 02:17:53.135543 5501 leader_election.cc:288] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 90dfdcce2cef45bab3bdcc75a9f667de (127.26.189.190:40257), 41deb06d810c4ae3a8b07fd7371e9eb8 (127.26.189.188:41015)
I20260806 02:17:53.136063 5503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.135312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:32946)
0806 02:17:53.135844 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.135942 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":70,"threads_started":1}
I20260806 02:17:53.136188 5509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.135668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:32952)
0806 02:17:53.136018 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.136094 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":79,"threads_started":1}
W20260806 02:17:53.136380 4765 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
W20260806 02:17:53.137019 4482 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
I20260806 02:17:53.138067 5503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.137343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:32960)
0806 02:17:53.137445 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.137495 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 02:17:53.138296 5509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.137843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:32976)
0806 02:17:53.138175 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.138228 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267}
W20260806 02:17:53.138576 4482 leader_election.cc:334] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 90dfdcce2cef45bab3bdcc75a9f667de (127.26.189.190:40257): Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
W20260806 02:17:53.138955 4765 leader_election.cc:334] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 90dfdcce2cef45bab3bdcc75a9f667de (127.26.189.190:40257): Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
I20260806 02:17:53.140586 5506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.135432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38128 (local address 127.26.189.189:42455)
0806 02:17:53.135986 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:53.135993 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:53.136018 (+ 25us) server_negotiation.cc:407] Connection header received
0806 02:17:53.136072 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:53.136075 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:53.136134 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:53.136549 (+ 415us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:53.136672 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.137978 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.139550 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.139984 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.140146 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.140211 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:53.140385 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 02:17:53.140466 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":474,"thread_start_us":90,"threads_started":1}
I20260806 02:17:53.140626 5504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.135303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:42455 (local address 127.0.0.1:38128)
0806 02:17:53.135642 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.135683 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:53.135805 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:53.136279 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:53.136283 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:53.136304 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:53.136431 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.136439 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.138118 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.138123 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.139398 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.139407 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.140149 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.140153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.140245 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.140274 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 02:17:53.140369 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 02:17:53.140489 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":26,"thread_start_us":68,"threads_started":1}
I20260806 02:17:53.140997 4520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" is_pre_election: true
I20260806 02:17:53.141165 4520 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41deb06d810c4ae3a8b07fd7371e9eb8 in term 1.
I20260806 02:17:53.141458 4762 leader_election.cc:302] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41deb06d810c4ae3a8b07fd7371e9eb8, 5c3fe87e80294bcd9b935119e4dec5f4; no voters: 90dfdcce2cef45bab3bdcc75a9f667de
I20260806 02:17:53.141496 5508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.135727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:41015 (local address 127.0.0.1:46580)
0806 02:17:53.136491 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.136508 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:53.136593 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:53.136949 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:53.136952 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:53.136971 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:53.137068 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.137074 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.139076 (+ 2002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.139079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.140175 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.140185 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.141017 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.141020 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.141168 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.141190 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 02:17:53.141287 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 02:17:53.141365 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"mutex_wait_us":1,"thread_start_us":51,"threads_started":1}
I20260806 02:17:53.141747 5502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 02:17:53.141505 5510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.136057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46580 (local address 127.26.189.188:41015)
0806 02:17:53.136279 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:53.136283 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:53.136583 (+ 300us) server_negotiation.cc:407] Connection header received
0806 02:17:53.136734 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:53.136765 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:53.136824 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:53.136913 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:53.137477 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.138946 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.140310 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.140891 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.141011 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.141059 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:53.141318 (+ 259us) server_negotiation.cc:299] Negotiation successful
0806 02:17:53.141387 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":159,"thread_start_us":66,"threads_started":1}
I20260806 02:17:53.141837 5502 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 90dfdcce2cef45bab3bdcc75a9f667de)
I20260806 02:17:53.141892 5502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 1 FOLLOWER]: Advancing to term 2
I20260806 02:17:53.142262 4796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" is_pre_election: true
I20260806 02:17:53.143083 5502 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } }
I20260806 02:17:53.143333 4796 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c3fe87e80294bcd9b935119e4dec5f4 in current term 2: Already voted for candidate 41deb06d810c4ae3a8b07fd7371e9eb8 in this term.
I20260806 02:17:53.143464 5502 leader_election.cc:288] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [CANDIDATE]: Term 2 election: Requested vote from peers 90dfdcce2cef45bab3bdcc75a9f667de (127.26.189.190:40257), 5c3fe87e80294bcd9b935119e4dec5f4 (127.26.189.189:42455)
I20260806 02:17:53.143816 4479 leader_election.cc:302] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c3fe87e80294bcd9b935119e4dec5f4; no voters: 41deb06d810c4ae3a8b07fd7371e9eb8, 90dfdcce2cef45bab3bdcc75a9f667de
I20260806 02:17:53.143887 5504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.143653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:32998)
0806 02:17:53.143786 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.143838 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 02:17:53.144400 5501 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 1 FOLLOWER]: Advancing to term 2
I20260806 02:17:53.144487 4520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5c3fe87e80294bcd9b935119e4dec5f4"
I20260806 02:17:53.144591 5504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.144329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:33006)
0806 02:17:53.144474 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.144531 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260806 02:17:53.144681 4765 leader_election.cc:334] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 90dfdcce2cef45bab3bdcc75a9f667de (127.26.189.190:40257): Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
I20260806 02:17:53.145457 5501 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:17:53.146440 4520 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41deb06d810c4ae3a8b07fd7371e9eb8 in term 2.
I20260806 02:17:53.147151 4762 leader_election.cc:302] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41deb06d810c4ae3a8b07fd7371e9eb8, 5c3fe87e80294bcd9b935119e4dec5f4; no voters: 90dfdcce2cef45bab3bdcc75a9f667de
I20260806 02:17:53.147336 5502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 02:17:53.147534 5502 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [term 2 LEADER]: Becoming Leader. State: Replica: 41deb06d810c4ae3a8b07fd7371e9eb8, State: Running, Role: LEADER
I20260806 02:17:53.147804 5502 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } }
I20260806 02:17:53.148814 5515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41deb06d810c4ae3a8b07fd7371e9eb8. Latest consensus state: current_term: 2 leader_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } } }
I20260806 02:17:53.148908 5515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:53.149263 5518 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:53.151592 5518 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:53.152009 5518 catalog_manager.cc:1259] Loaded cluster ID: bd474ef98e13448cbeaaf9c45a767a4d
I20260806 02:17:53.152058 5518 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:53.152639 5518 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:53.153044 5518 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: Loaded TSK: 0
I20260806 02:17:53.153820 5518 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:17:53.200668 4785 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:17:53.207532 4785 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:53.212285 5504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.211844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:33014)
0806 02:17:53.212075 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.212155 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260806 02:17:53.213855 5504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.212927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.0.0.1:33018)
0806 02:17:53.213655 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.213748 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":601}
W20260806 02:17:53.214021 4765 consensus_peers.cc:487] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 -> Peer 90dfdcce2cef45bab3bdcc75a9f667de (127.26.189.190:40257): Couldn't send request to peer 90dfdcce2cef45bab3bdcc75a9f667de. Status: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 02:17:53.218108 4520 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [term 2 FOLLOWER]: Refusing update from remote peer 41deb06d810c4ae3a8b07fd7371e9eb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260806 02:17:53.218847 5515 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260806 02:17:53.222198 5501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41deb06d810c4ae3a8b07fd7371e9eb8. Latest consensus state: current_term: 2 leader_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } } }
I20260806 02:17:53.222344 5501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:17:53.223932 5502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } } }
I20260806 02:17:53.224086 5502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8 [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:53.225307 5501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "90dfdcce2cef45bab3bdcc75a9f667de" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40257 } } peers { permanent_uuid: "5c3fe87e80294bcd9b935119e4dec5f4" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 42455 } attrs { promote: false } } peers { permanent_uuid: "41deb06d810c4ae3a8b07fd7371e9eb8" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 41015 } attrs { promote: false } } }
I20260806 02:17:53.225433 5501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c3fe87e80294bcd9b935119e4dec5f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:17:53.226648 5520 mvcc.cc:205] Tried to move back new op lower bound from 7315385029470789632 to 7315385029215789056. Current Snapshot: MvccSnapshot[applied={T|T < 7315385029470789632 or (T in {7315385029470789632})}]
I20260806 02:17:53.236635 5529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.231392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38345 (local address 127.0.0.1:39754)
0806 02:17:53.231751 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.231767 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:53.231869 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:53.232767 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:53.232770 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:53.232786 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:53.232865 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.232870 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.233887 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.233890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.235227 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.235238 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.236159 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.236178 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.236281 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.236314 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 02:17:53.236368 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 02:17:53.236448 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":227,"thread_start_us":89,"threads_started":1}
I20260806 02:17:53.236884 5503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.231056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:44587 (local address 127.0.0.1:45938)
0806 02:17:53.231396 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.231413 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:53.231507 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:53.232414 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:53.232417 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:53.232437 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:53.232559 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.232565 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.233814 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.233819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.235252 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.235267 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.236213 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.236217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.236475 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.236520 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 02:17:53.236585 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 02:17:53.236689 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":104}
I20260806 02:17:53.237640 5530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.231488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39754 (local address 127.26.189.129:38345)
0806 02:17:53.232497 (+ 1009us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:53.232502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:53.232516 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:17:53.232571 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:53.232574 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:53.232629 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:53.232734 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:53.233004 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.233771 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.235385 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.236017 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.237235 (+ 1218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.237298 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:53.237342 (+ 44us) server_negotiation.cc:299] Negotiation successful
0806 02:17:53.237429 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":913,"thread_start_us":61,"threads_started":1}
I20260806 02:17:53.237776 5533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.231881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45938 (local address 127.26.189.130:44587)
0806 02:17:53.232130 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:53.232134 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:53.232150 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:17:53.232215 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:53.232218 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:53.232274 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:53.232677 (+ 403us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:53.232811 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.233667 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.235417 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.236055 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.237221 (+ 1166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.237303 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:53.237347 (+ 44us) server_negotiation.cc:299] Negotiation successful
0806 02:17:53.237452 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":100,"threads_started":1}
I20260806 02:17:53.237833 5504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.231283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:34487 (local address 127.0.0.1:59040)
0806 02:17:53.231524 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.231537 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:53.231595 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:53.232479 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:53.232481 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:53.232502 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:53.232600 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.232606 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.233885 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.233889 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.236444 (+ 2555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.236452 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.237398 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.237402 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.237491 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.237552 (+ 61us) client_negotiation.cc:769] Sending connection context
0806 02:17:53.237603 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 02:17:53.237701 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":1327}
I20260806 02:17:53.238565 4938 tablet_service.cc:1467] Processing CreateTablet for tablet 1a50ae6a3f7a4e649acdfc9c26fb984d (DEFAULT_TABLE table=test-table [id=9c1638e185d84881a9cbfd2e89d9b65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:53.238631 5531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.231855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59040 (local address 127.26.189.131:34487)
0806 02:17:53.232195 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:53.232198 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:53.232209 (+ 11us) server_negotiation.cc:407] Connection header received
0806 02:17:53.232253 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:53.232255 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:53.232346 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:53.232742 (+ 396us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:53.232862 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.233746 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.236577 (+ 2831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.237260 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.238302 (+ 1042us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.238366 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:53.238407 (+ 41us) server_negotiation.cc:299] Negotiation successful
0806 02:17:53.238490 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":75,"threads_started":1}
I20260806 02:17:53.238909 4938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a50ae6a3f7a4e649acdfc9c26fb984d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:53.239058 5116 tablet_service.cc:1467] Processing CreateTablet for tablet 1a50ae6a3f7a4e649acdfc9c26fb984d (DEFAULT_TABLE table=test-table [id=9c1638e185d84881a9cbfd2e89d9b65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:53.239179 5302 tablet_service.cc:1467] Processing CreateTablet for tablet 1a50ae6a3f7a4e649acdfc9c26fb984d (DEFAULT_TABLE table=test-table [id=9c1638e185d84881a9cbfd2e89d9b65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:53.239318 5116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a50ae6a3f7a4e649acdfc9c26fb984d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:53.239410 5302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a50ae6a3f7a4e649acdfc9c26fb984d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:53.241756 5534 tablet_bootstrap.cc:492] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74: Bootstrap starting.
I20260806 02:17:53.242204 5535 tablet_bootstrap.cc:492] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59: Bootstrap starting.
I20260806 02:17:53.242818 5534 tablet_bootstrap.cc:654] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:53.243482 5535 tablet_bootstrap.cc:654] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:53.244319 5538 tablet_bootstrap.cc:492] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804: Bootstrap starting.
I20260806 02:17:53.244710 5534 tablet_bootstrap.cc:492] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74: No bootstrap required, opened a new log
I20260806 02:17:53.244874 5534 ts_tablet_manager.cc:1397] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 02:17:53.245397 5538 tablet_bootstrap.cc:654] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:53.245674 5534 raft_consensus.cc:348] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } } peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } }
I20260806 02:17:53.245918 5534 raft_consensus.cc:374] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:53.246022 5534 raft_consensus.cc:729] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07dd0041edd843e7a3b6b9ae5dfeef74, State: Initialized, Role: FOLLOWER
I20260806 02:17:53.246272 5534 consensus_queue.cc:260] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } } peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } }
I20260806 02:17:53.246788 5535 tablet_bootstrap.cc:492] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59: No bootstrap required, opened a new log
I20260806 02:17:53.246793 5534 ts_tablet_manager.cc:1428] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260806 02:17:53.246906 5535 ts_tablet_manager.cc:1397] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 02:17:53.247499 5535 raft_consensus.cc:348] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } } peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } }
I20260806 02:17:53.247630 5535 raft_consensus.cc:374] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:53.247668 5535 raft_consensus.cc:729] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1213b43a4bb4c86bd8fcbb05379fb59, State: Initialized, Role: FOLLOWER
I20260806 02:17:53.247859 5535 consensus_queue.cc:260] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } } peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } }
I20260806 02:17:53.248199 5535 ts_tablet_manager.cc:1428] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 02:17:53.248895 5544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.247438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.131:48851)
0806 02:17:53.248724 (+ 1286us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.248792 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1198,"thread_start_us":110,"threads_started":1}
I20260806 02:17:53.251312 5544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.249942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.131:57099)
0806 02:17:53.251176 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.251229 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1162}
I20260806 02:17:53.251657 5392 heartbeater.cc:503] Master 127.26.189.188:41015 was elected leader, sending a full tablet report...
I20260806 02:17:53.252339 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.251220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.129:50007)
0806 02:17:53.252098 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.252161 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":807,"thread_start_us":109,"threads_started":1}
I20260806 02:17:53.253031 5023 heartbeater.cc:503] Master 127.26.189.188:41015 was elected leader, sending a full tablet report...
I20260806 02:17:53.253247 5538 tablet_bootstrap.cc:492] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804: No bootstrap required, opened a new log
I20260806 02:17:53.253372 5538 ts_tablet_manager.cc:1397] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260806 02:17:53.254070 5538 raft_consensus.cc:348] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } } peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } }
I20260806 02:17:53.254226 5538 raft_consensus.cc:374] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:53.254268 5538 raft_consensus.cc:729] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba92d15617ab488b859f55bff4b37804, State: Initialized, Role: FOLLOWER
I20260806 02:17:53.254400 5538 consensus_queue.cc:260] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } } peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } }
I20260806 02:17:53.256341 5538 ts_tablet_manager.cc:1428] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260806 02:17:53.256516 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.255616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.129:42049)
0806 02:17:53.256372 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.256428 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":518,"threads_started":1}
I20260806 02:17:53.258035 5552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.257362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.130:57561)
0806 02:17:53.257845 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.257911 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":103,"threads_started":1}
I20260806 02:17:53.259516 5552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.259187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.130:55905)
0806 02:17:53.259359 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.259421 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 02:17:53.259552 5199 heartbeater.cc:503] Master 127.26.189.188:41015 was elected leader, sending a full tablet report...
I20260806 02:17:53.365284 5547 raft_consensus.cc:482] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:53.365425 5547 raft_consensus.cc:504] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } } peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } }
I20260806 02:17:53.366569 5547 leader_election.cc:288] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba92d15617ab488b859f55bff4b37804 (127.26.189.130:44587), 07dd0041edd843e7a3b6b9ae5dfeef74 (127.26.189.131:34487)
I20260806 02:17:53.370875 5531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.367363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:41049 (local address 127.26.189.131:34487)
0806 02:17:53.367501 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:53.367506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:53.367519 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:17:53.367568 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:53.367571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:53.367624 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:53.367720 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:53.368008 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.368531 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.369774 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.370195 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.370332 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.370397 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:53.370643 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 02:17:53.370737 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 02:17:53.370884 5551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.366841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:44587 (local address 127.26.189.129:52095)
0806 02:17:53.366987 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.367005 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:53.367123 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:53.367494 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:53.367498 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:53.367516 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:53.367660 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.367669 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.368535 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.368539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.369449 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.369459 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.370375 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.370379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.370503 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.370540 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 02:17:53.370643 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 02:17:53.370741 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":23}
I20260806 02:17:53.370915 5533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.366973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:52095 (local address 127.26.189.130:44587)
0806 02:17:53.367127 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:53.367131 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:53.367215 (+ 84us) server_negotiation.cc:407] Connection header received
0806 02:17:53.367285 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:53.367288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:53.367339 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:53.367417 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:53.367787 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.368416 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.369637 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.370198 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.370359 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.370423 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:53.370698 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 02:17:53.370795 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 02:17:53.370901 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.367152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:34487 (local address 127.26.189.129:41049)
0806 02:17:53.367289 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.367303 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:53.367381 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:53.367756 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:53.367760 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:53.367781 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:53.367888 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.367895 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.368664 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.368667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.369641 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:53.369653 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.370332 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.370336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:53.370452 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.370525 (+ 73us) client_negotiation.cc:769] Sending connection context
0806 02:17:53.370598 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 02:17:53.370739 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":38}
I20260806 02:17:53.371628 5142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a50ae6a3f7a4e649acdfc9c26fb984d" candidate_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba92d15617ab488b859f55bff4b37804" is_pre_election: true
I20260806 02:17:53.371716 5328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a50ae6a3f7a4e649acdfc9c26fb984d" candidate_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" is_pre_election: true
I20260806 02:17:53.371816 5142 raft_consensus.cc:2454] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1213b43a4bb4c86bd8fcbb05379fb59 in term 0.
I20260806 02:17:53.371996 5328 raft_consensus.cc:2454] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1213b43a4bb4c86bd8fcbb05379fb59 in term 0.
I20260806 02:17:53.372221 4877 leader_election.cc:302] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1213b43a4bb4c86bd8fcbb05379fb59, ba92d15617ab488b859f55bff4b37804; no voters:
I20260806 02:17:53.372509 5547 raft_consensus.cc:2781] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:53.372572 5547 raft_consensus.cc:482] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:53.372629 5547 raft_consensus.cc:3037] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:53.373845 5547 raft_consensus.cc:504] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } } peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } }
I20260806 02:17:53.374243 5547 leader_election.cc:288] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [CANDIDATE]: Term 1 election: Requested vote from peers ba92d15617ab488b859f55bff4b37804 (127.26.189.130:44587), 07dd0041edd843e7a3b6b9ae5dfeef74 (127.26.189.131:34487)
I20260806 02:17:53.374609 5142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a50ae6a3f7a4e649acdfc9c26fb984d" candidate_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba92d15617ab488b859f55bff4b37804"
I20260806 02:17:53.374770 5142 raft_consensus.cc:3037] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:53.374761 5328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a50ae6a3f7a4e649acdfc9c26fb984d" candidate_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74"
I20260806 02:17:53.374904 5328 raft_consensus.cc:3037] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:53.375988 5142 raft_consensus.cc:2454] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1213b43a4bb4c86bd8fcbb05379fb59 in term 1.
I20260806 02:17:53.376024 5328 raft_consensus.cc:2454] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1213b43a4bb4c86bd8fcbb05379fb59 in term 1.
I20260806 02:17:53.376322 4877 leader_election.cc:302] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07dd0041edd843e7a3b6b9ae5dfeef74, a1213b43a4bb4c86bd8fcbb05379fb59; no voters:
I20260806 02:17:53.376502 5547 raft_consensus.cc:2781] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:53.376765 5547 raft_consensus.cc:686] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [term 1 LEADER]: Becoming Leader. State: Replica: a1213b43a4bb4c86bd8fcbb05379fb59, State: Running, Role: LEADER
I20260806 02:17:53.377116 5547 consensus_queue.cc:237] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } } peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } }
I20260806 02:17:53.377465 5551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.377234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.129:44517)
0806 02:17:53.377346 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.377399 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 02:17:53.379570 4785 catalog_manager.cc:5495] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1213b43a4bb4c86bd8fcbb05379fb59 (127.26.189.129). New cstate: current_term: 1 leader_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1213b43a4bb4c86bd8fcbb05379fb59" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38345 } health_report { overall_health: HEALTHY } } }
I20260806 02:17:53.397405 5530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.393226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39756 (local address 127.26.189.129:38345)
0806 02:17:53.393353 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:53.393357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:53.393370 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:17:53.393661 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:53.393664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:53.393732 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:53.393839 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:53.394115 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.394640 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.395881 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:53.396099 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:53.396282 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:53.396574 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:53.397020 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:53.397156 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:53.397228 (+ 72us) server_negotiation.cc:299] Negotiation successful
0806 02:17:53.397289 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 02:17:53.400436 5142 raft_consensus.cc:1261] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804 [term 1 FOLLOWER]: Refusing update from remote peer a1213b43a4bb4c86bd8fcbb05379fb59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:53.400668 5328 raft_consensus.cc:1261] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 1 FOLLOWER]: Refusing update from remote peer a1213b43a4bb4c86bd8fcbb05379fb59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:53.401029 5547 consensus_queue.cc:1035] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba92d15617ab488b859f55bff4b37804" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 44587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:53.401305 5553 consensus_queue.cc:1035] T 1a50ae6a3f7a4e649acdfc9c26fb984d P a1213b43a4bb4c86bd8fcbb05379fb59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07dd0041edd843e7a3b6b9ae5dfeef74" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 34487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:53.403119 5552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.402705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.130:32989)
0806 02:17:53.402866 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.402939 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260806 02:17:53.405195 5544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.404426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.131:53761)
0806 02:17:53.405044 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.405117 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":547}
I20260806 02:17:53.407148 5559 mvcc.cc:205] Tried to move back new op lower bound from 7315385030242566144 to 7315385030155616256. Current Snapshot: MvccSnapshot[applied={T|T < 7315385030242566144}]
I20260806 02:17:53.407439 5552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.406865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.130:48535)
0806 02:17:53.407315 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.407369 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378}
I20260806 02:17:53.408836 5544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.408527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.131:34197)
0806 02:17:53.408705 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.408760 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260806 02:17:53.410702 5560 mvcc.cc:205] Tried to move back new op lower bound from 7315385030242566144 to 7315385030155616256. Current Snapshot: MvccSnapshot[applied={T|T < 7315385030242566144 or (T in {7315385030242566144})}]
I20260806 02:17:53.411661 5551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.407138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:40257 (local address 127.26.189.129:57713)
0806 02:17:53.411501 (+ 4363us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.411578 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4287}
I20260806 02:17:53.414728 4785 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:53.414906 4785 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:53.419499 4785 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 41deb06d810c4ae3a8b07fd7371e9eb8: Sending DeleteTablet for 3 replicas of tablet 1a50ae6a3f7a4e649acdfc9c26fb984d
I20260806 02:17:53.420260 5116 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a50ae6a3f7a4e649acdfc9c26fb984d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:53 UTC) from {username='oryx', principal='oryx/127.26.189.188@KRBTEST.COM'} at 127.0.0.1:45938
I20260806 02:17:53.420380 4938 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a50ae6a3f7a4e649acdfc9c26fb984d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:53 UTC) from {username='oryx', principal='oryx/127.26.189.188@KRBTEST.COM'} at 127.0.0.1:39754
I20260806 02:17:53.420635 5302 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a50ae6a3f7a4e649acdfc9c26fb984d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:53 UTC) from {username='oryx', principal='oryx/127.26.189.188@KRBTEST.COM'} at 127.0.0.1:59040
I20260806 02:17:53.421032 5572 tablet_replica.cc:330] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74: stopping tablet replica
I20260806 02:17:53.421056 5569 tablet_replica.cc:330] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804: stopping tablet replica
I20260806 02:17:53.421155 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 4718
I20260806 02:17:53.421195 5569 raft_consensus.cc:2229] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:53.421345 5572 raft_consensus.cc:2229] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:53.421562 5572 raft_consensus.cc:2258] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:53.421862 5569 raft_consensus.cc:2258] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:53.425318 5569 ts_tablet_manager.cc:1905] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:53.425374 5572 ts_tablet_manager.cc:1905] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:53.427747 5569 ts_tablet_manager.cc:1918] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:53.427863 5569 log.cc:1196] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/1a50ae6a3f7a4e649acdfc9c26fb984d
I20260806 02:17:53.428194 5569 ts_tablet_manager.cc:1939] T 1a50ae6a3f7a4e649acdfc9c26fb984d P ba92d15617ab488b859f55bff4b37804: Deleting consensus metadata
I20260806 02:17:53.429034 4766 catalog_manager.cc:4841] TS ba92d15617ab488b859f55bff4b37804 (127.26.189.130:44587): tablet 1a50ae6a3f7a4e649acdfc9c26fb984d (table test-table [id=9c1638e185d84881a9cbfd2e89d9b65f]) successfully deleted
I20260806 02:17:53.429275 5572 ts_tablet_manager.cc:1918] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:53.429381 5572 log.cc:1196] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/1a50ae6a3f7a4e649acdfc9c26fb984d
I20260806 02:17:53.429736 5572 ts_tablet_manager.cc:1939] T 1a50ae6a3f7a4e649acdfc9c26fb984d P 07dd0041edd843e7a3b6b9ae5dfeef74: Deleting consensus metadata
I20260806 02:17:53.430760 4766 catalog_manager.cc:4841] TS 07dd0041edd843e7a3b6b9ae5dfeef74 (127.26.189.131:34487): tablet 1a50ae6a3f7a4e649acdfc9c26fb984d (table test-table [id=9c1638e185d84881a9cbfd2e89d9b65f]) successfully deleted
I20260806 02:17:53.436393 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 5032
I20260806 02:17:53.438673 5504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:53.436486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38345 (local address 127.0.0.1:39764)
0806 02:17:53.438486 (+ 2000us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:53.438560 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:38345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1886}
W20260806 02:17:53.442008 4762 catalog_manager.cc:4584] TS a1213b43a4bb4c86bd8fcbb05379fb59 (127.26.189.129:38345): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1a50ae6a3f7a4e649acdfc9c26fb984d: Network error: Client connection negotiation failed: client connection to 127.26.189.129:38345: connect: Connection refused (error 111)
I20260806 02:17:53.447956 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 5210
I20260806 02:17:53.462018 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 4310
I20260806 02:17:53.474076 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 4457
2026-08-06T02:17:53Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6272 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:53 dist-test-slave-gkw7 krb5kdc[5575](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:53 dist-test-slave-gkw7 krb5kdc[5575](info): set up 2 sockets
Aug 06 02:17:53 dist-test-slave-gkw7 krb5kdc[5575](info): commencing operation
krb5kdc: starting...
W20260806 02:17:54.680757 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:54 dist-test-slave-gkw7 krb5kdc[5575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982674, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:54Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.190.keytab.
Entry for principal oryx/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.190.keytab.
I20260806 02:17:54.812891 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39175
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.190.keytab
--principal=oryx/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:39175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:54.932897 5590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:54.933190 5590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:54.933235 5590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:54.937337 5590 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:54.937408 5590 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 02:17:54.937429 5590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:54.937450 5590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:54.937469 5590 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:54.937562 5590 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:54.942925 5590 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:39175
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.190.keytab
--principal=oryx/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:54.944007 5590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:54.945104 5590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:54.954388 5596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:54.954622 5590 server_base.cc:1034] running on GCE node
W20260806 02:17:54.954381 5602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:54.954382 5598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:54.955446 5590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:54.956526 5590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:54.957702 5590 hybrid_clock.cc:648] HybridClock initialized: now 1785982674957668 us; error 44 us; skew 500 ppm
Aug 06 02:17:54 dist-test-slave-gkw7 krb5kdc[5575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982674, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:54.964174 5590 init.cc:377] Logged in from keytab as oryx/127.26.189.190@KRBTEST.COM (short username oryx)
I20260806 02:17:54.965204 5590 webserver.cc:460] Webserver started at http://127.26.189.190:38973/ using document root <none> and password file <none>
I20260806 02:17:54.965895 5590 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:54.965965 5590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:54.966225 5590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:54.968457 5590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "015cc23312a84d74aa97a3a5a8c0efcc"
format_stamp: "Formatted at 2026-08-06 02:17:54 on dist-test-slave-gkw7"
server_key: "8f5d690f42fc4b737d5a8948659306ad"
server_key_iv: "400d458a579e71f4b7afa2cddf081fb7"
server_key_version: "encryptionkey@0"
I20260806 02:17:54.969106 5590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "015cc23312a84d74aa97a3a5a8c0efcc"
format_stamp: "Formatted at 2026-08-06 02:17:54 on dist-test-slave-gkw7"
server_key: "8f5d690f42fc4b737d5a8948659306ad"
server_key_iv: "400d458a579e71f4b7afa2cddf081fb7"
server_key_version: "encryptionkey@0"
I20260806 02:17:54.973122 5590 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:17:54.975829 5610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:54.977183 5590 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 02:17:54.977339 5590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "015cc23312a84d74aa97a3a5a8c0efcc"
format_stamp: "Formatted at 2026-08-06 02:17:54 on dist-test-slave-gkw7"
server_key: "8f5d690f42fc4b737d5a8948659306ad"
server_key_iv: "400d458a579e71f4b7afa2cddf081fb7"
server_key_version: "encryptionkey@0"
I20260806 02:17:54.977458 5590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:55.001338 5590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:55.005005 5590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:55.005224 5590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:55.013856 5590 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:39175
I20260806 02:17:55.013890 5696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:39175 every 8 connection(s)
I20260806 02:17:55.014853 5590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:17:55.017921 5697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:55.020715 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 5590
I20260806 02:17:55.020882 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:17:55.021190 27382 external_mini_cluster.cc:1428] Setting key a577432568d661595770a3624fb92c87
I20260806 02:17:55.024219 5697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc: Bootstrap starting.
I20260806 02:17:55.027040 5697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:55.027989 5697 log.cc:824] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:55.030084 5697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc: No bootstrap required, opened a new log
Aug 06 02:17:55 dist-test-slave-gkw7 krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982674, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:55.033761 5697 raft_consensus.cc:348] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015cc23312a84d74aa97a3a5a8c0efcc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39175 } }
I20260806 02:17:55.034022 5697 raft_consensus.cc:374] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:55.034102 5697 raft_consensus.cc:729] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 015cc23312a84d74aa97a3a5a8c0efcc, State: Initialized, Role: FOLLOWER
I20260806 02:17:55.034638 5697 consensus_queue.cc:260] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015cc23312a84d74aa97a3a5a8c0efcc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39175 } }
I20260806 02:17:55.034812 5697 raft_consensus.cc:388] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:17:55.034893 5697 raft_consensus.cc:482] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:17:55.035002 5697 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:55.036150 5697 raft_consensus.cc:504] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015cc23312a84d74aa97a3a5a8c0efcc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39175 } }
I20260806 02:17:55.036515 5697 leader_election.cc:302] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 015cc23312a84d74aa97a3a5a8c0efcc; no voters:
I20260806 02:17:55.036876 5697 leader_election.cc:288] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:17:55.036911 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.022707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50364 (local address 127.26.189.190:39175)
0806 02:17:55.023146 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:55.023163 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:55.023201 (+ 38us) server_negotiation.cc:407] Connection header received
0806 02:17:55.023845 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:55.023863 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:55.024201 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:55.024546 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:55.025469 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.026556 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.027810 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.028344 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.028531 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.031378 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:55.031384 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:55.031398 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:55.031425 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:55.033210 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.033773 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.033778 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.033783 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.033900 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.034209 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.034213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.034215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.034735 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:55.034982 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:55.035528 (+ 546us) server_negotiation.cc:299] Negotiation successful
0806 02:17:55.035861 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":147,"threads_started":1}
I20260806 02:17:55.036998 5707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:55.037245 5707 raft_consensus.cc:686] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [term 1 LEADER]: Becoming Leader. State: Replica: 015cc23312a84d74aa97a3a5a8c0efcc, State: Running, Role: LEADER
I20260806 02:17:55.037585 5707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015cc23312a84d74aa97a3a5a8c0efcc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39175 } }
I20260806 02:17:55.038185 5697 sys_catalog.cc:564] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:17:55.039418 5710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 015cc23312a84d74aa97a3a5a8c0efcc. Latest consensus state: current_term: 1 leader_uuid: "015cc23312a84d74aa97a3a5a8c0efcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015cc23312a84d74aa97a3a5a8c0efcc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39175 } } }
I20260806 02:17:55.039568 5710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [sys.catalog]: This master's current role is: LEADER
I20260806 02:17:55.039707 5708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "015cc23312a84d74aa97a3a5a8c0efcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015cc23312a84d74aa97a3a5a8c0efcc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39175 } } }
I20260806 02:17:55.039808 5708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc [sys.catalog]: This master's current role is: LEADER
W20260806 02:17:55.043118 5724 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:17:55.043206 5724 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:17:55.043292 5717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:17:55.044009 5717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:17:55.050009 5717 catalog_manager.cc:1347] Generated new cluster ID: 21510ffc30c0428398af93565fce92f8
I20260806 02:17:55.050114 5717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:17:55.059903 5717 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:17:55.060990 5717 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:17:55.067885 5717 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc: Generated new TSK 0
I20260806 02:17:55.068804 5717 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab.
Entry for principal oryx/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab.
I20260806 02:17:55.108544 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39175
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab
--principal=oryx/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:55.234666 5730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:55.234984 5730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:55.235062 5730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:55.239197 5730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:55.239339 5730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:55.239446 5730 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 02:17:55.239521 5730 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:17:55.244922 5730 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab
--principal=oryx/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.189.190:39175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5730
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:55.246062 5730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:55.247151 5730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:55.257714 5738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:55.257714 5740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:55.257850 5744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:55.257850 5730 server_base.cc:1034] running on GCE node
I20260806 02:17:55.258430 5730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:55.259158 5730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:55.260365 5730 hybrid_clock.cc:648] HybridClock initialized: now 1785982675260348 us; error 29 us; skew 500 ppm
Aug 06 02:17:55 dist-test-slave-gkw7 krb5kdc[5575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982675, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:55.263397 5730 init.cc:377] Logged in from keytab as oryx/127.26.189.129@KRBTEST.COM (short username oryx)
I20260806 02:17:55.264340 5730 webserver.cc:460] Webserver started at http://127.26.189.129:34731/ using document root <none> and password file <none>
I20260806 02:17:55.264953 5730 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:55.265056 5730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:55.265307 5730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:55.267524 5730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c"
format_stamp: "Formatted at 2026-08-06 02:17:55 on dist-test-slave-gkw7"
server_key: "9f85b868c5fe0aee55471715541921a4"
server_key_iv: "05849d1a8c51b3ca3b6341019eb3279b"
server_key_version: "encryptionkey@0"
I20260806 02:17:55.268133 5730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c"
format_stamp: "Formatted at 2026-08-06 02:17:55 on dist-test-slave-gkw7"
server_key: "9f85b868c5fe0aee55471715541921a4"
server_key_iv: "05849d1a8c51b3ca3b6341019eb3279b"
server_key_version: "encryptionkey@0"
I20260806 02:17:55.272209 5730 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:55.276624 5752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:55.278342 5730 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 02:17:55.278487 5730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c"
format_stamp: "Formatted at 2026-08-06 02:17:55 on dist-test-slave-gkw7"
server_key: "9f85b868c5fe0aee55471715541921a4"
server_key_iv: "05849d1a8c51b3ca3b6341019eb3279b"
server_key_version: "encryptionkey@0"
I20260806 02:17:55.278640 5730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:55.314126 5730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:55.318619 5730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:55.318807 5730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:55.320386 5730 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:55.320444 5730 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:55.320520 5730 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:55.320561 5730 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 02:17:55 dist-test-slave-gkw7 krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982675, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:55.331480 5730 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:41683
I20260806 02:17:55.331513 5918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:41683 every 8 connection(s)
I20260806 02:17:55.332589 5730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:17:55.336230 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.321340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:34499 (local address 127.26.189.190:39175)
0806 02:17:55.321509 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:55.321515 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:55.322434 (+ 919us) server_negotiation.cc:407] Connection header received
0806 02:17:55.323825 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:55.323830 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:55.323888 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:55.323974 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:55.325994 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.326861 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.328647 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.328932 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.329050 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.332085 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:55.332090 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:55.332092 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:55.332123 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:55.333949 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.334767 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.334770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.334771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.334857 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.335209 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.335211 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.335213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.335415 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:55.335495 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:55.335965 (+ 470us) server_negotiation.cc:299] Negotiation successful
0806 02:17:55.336078 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 02:17:55.337297 5761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.321791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39175 (local address 127.26.189.129:34499)
0806 02:17:55.322285 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:55.322336 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:55.323544 (+ 1208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:55.324455 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:55.324465 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:55.324960 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:55.325827 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.325848 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.326979 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.326983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.328505 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.328517 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.329107 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.329112 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.329320 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.330089 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:55.330112 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:55.331896 (+ 1784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:55.334115 (+ 2219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:55.334122 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:55.334137 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:55.334618 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:55.334954 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:55.334957 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:55.334958 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:55.335102 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:55.335512 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:55.335517 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:55.335746 (+ 229us) client_negotiation.cc:769] Sending connection context
0806 02:17:55.335896 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 02:17:55.336183 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":129,"threads_started":1}
I20260806 02:17:55.337745 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 5730
I20260806 02:17:55.337900 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:17:55.338310 27382 external_mini_cluster.cc:1428] Setting key b5af9242efd420c47f6d3d3f7e330b8e
I20260806 02:17:55.339238 5919 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39175
I20260806 02:17:55.339413 5919 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:55.340233 5919 heartbeater.cc:511] Master 127.26.189.190:39175 requested a full tablet report, sending...
I20260806 02:17:55.342196 5634 ts_manager.cc:194] Registered new tserver with Master: 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683)
I20260806 02:17:55.343536 5634 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:34499
WARNING: no policy specified for oryx/127.26.189.130@KRBTEST.COM; defaulting to no policy
I20260806 02:17:55.353075 5925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.341991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39175 (local address 127.26.189.129:40097)
0806 02:17:55.342342 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:55.342360 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:55.342474 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:55.344159 (+ 1685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:55.344165 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:55.344469 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:55.344659 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.344673 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.345856 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.345863 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.347065 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.347084 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.347641 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.347650 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.347805 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.348436 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:55.348460 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:55.349007 (+ 547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:55.351153 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:55.351157 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:55.351160 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:55.351474 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:55.351889 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:55.351896 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:55.351901 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:55.352026 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:55.352494 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:55.352498 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:55.352657 (+ 159us) client_negotiation.cc:769] Sending connection context
0806 02:17:55.352779 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 02:17:55.352924 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":139,"threads_started":1}
I20260806 02:17:55.353108 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.342074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:40097 (local address 127.26.189.190:39175)
0806 02:17:55.343889 (+ 1815us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:55.343894 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:55.343911 (+ 17us) server_negotiation.cc:407] Connection header received
0806 02:17:55.343951 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:55.343954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:55.343997 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:55.344099 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:55.344819 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.345685 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.347242 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.347480 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.347611 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.349226 (+ 1615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:55.349229 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:55.349232 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:55.349257 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:55.351018 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.351678 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.351681 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.351682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.351769 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.352161 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.352164 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.352165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.352366 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:55.352456 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:55.352879 (+ 423us) server_negotiation.cc:299] Negotiation successful
0806 02:17:55.352988 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1727}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab.
Entry for principal oryx/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab.
I20260806 02:17:55.373014 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39175
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab
--principal=oryx/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:55.497629 5929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:55.497903 5929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:55.497952 5929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:55.502056 5929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:55.502121 5929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:55.502161 5929 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 02:17:55.502193 5929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:17:55.507377 5929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab
--principal=oryx/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.189.190:39175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:55.508495 5929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:55.509567 5929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:55.519644 5937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:55.519637 5940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:55.519642 5936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:55.520136 5929 server_base.cc:1034] running on GCE node
I20260806 02:17:55.520606 5929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:55.521306 5929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:55.522509 5929 hybrid_clock.cc:648] HybridClock initialized: now 1785982675522490 us; error 40 us; skew 500 ppm
Aug 06 02:17:55 dist-test-slave-gkw7 krb5kdc[5575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982675, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:55.525478 5929 init.cc:377] Logged in from keytab as oryx/127.26.189.130@KRBTEST.COM (short username oryx)
I20260806 02:17:55.526520 5929 webserver.cc:460] Webserver started at http://127.26.189.130:43381/ using document root <none> and password file <none>
I20260806 02:17:55.527118 5929 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:55.527217 5929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:55.527465 5929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:55.529726 5929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "dc36ea51d2cb41cb914a292289ee8a2e"
format_stamp: "Formatted at 2026-08-06 02:17:55 on dist-test-slave-gkw7"
server_key: "11c5ecf9f071cf4b367a1df746cf252f"
server_key_iv: "acd204aa50a3093098b6ec03a0360023"
server_key_version: "encryptionkey@0"
I20260806 02:17:55.530303 5929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "dc36ea51d2cb41cb914a292289ee8a2e"
format_stamp: "Formatted at 2026-08-06 02:17:55 on dist-test-slave-gkw7"
server_key: "11c5ecf9f071cf4b367a1df746cf252f"
server_key_iv: "acd204aa50a3093098b6ec03a0360023"
server_key_version: "encryptionkey@0"
I20260806 02:17:55.534132 5929 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 02:17:55.536722 5949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:55.538066 5929 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:55.538224 5929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "dc36ea51d2cb41cb914a292289ee8a2e"
format_stamp: "Formatted at 2026-08-06 02:17:55 on dist-test-slave-gkw7"
server_key: "11c5ecf9f071cf4b367a1df746cf252f"
server_key_iv: "acd204aa50a3093098b6ec03a0360023"
server_key_version: "encryptionkey@0"
I20260806 02:17:55.538331 5929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:55.555883 5929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:55.559177 5929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:55.559396 5929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:55.561009 5929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:55.561061 5929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:55.561103 5929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:55.561118 5929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 02:17:55 dist-test-slave-gkw7 krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982675, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:55.573946 5929 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:35503
I20260806 02:17:55.573968 6111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:35503 every 8 connection(s)
I20260806 02:17:55.575256 5929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:17:55.578248 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.562244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:59587 (local address 127.26.189.190:39175)
0806 02:17:55.562390 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:55.562394 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:55.563541 (+ 1147us) server_negotiation.cc:407] Connection header received
0806 02:17:55.564783 (+ 1242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:55.564787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:55.564855 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:55.564970 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:55.566457 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.567057 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.569216 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.569621 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.569765 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.574042 (+ 4277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:55.574047 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:55.574050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:55.574088 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:55.575845 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.576586 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.576590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.576591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.576702 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.577043 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.577045 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.577047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.577265 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:55.577354 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:55.577995 (+ 641us) server_negotiation.cc:299] Negotiation successful
0806 02:17:55.578110 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:17:55.579058 5964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.562819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39175 (local address 127.26.189.130:59587)
0806 02:17:55.563373 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:55.563420 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:55.564547 (+ 1127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:55.565189 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:55.565197 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:55.565767 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:55.566289 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.566303 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.567222 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.567226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.569067 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.569082 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.569855 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.569862 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.570133 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.571632 (+ 1499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:55.571660 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:55.573848 (+ 2188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:55.576056 (+ 2208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:55.576068 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:55.576084 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:55.576481 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:55.576803 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:55.576805 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:55.576807 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:55.576950 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:55.577404 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:55.577409 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:55.577721 (+ 312us) client_negotiation.cc:769] Sending connection context
0806 02:17:55.577907 (+ 186us) client_negotiation.cc:240] Negotiation successful
0806 02:17:55.578170 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":153,"threads_started":1}
I20260806 02:17:55.580435 6113 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39175
I20260806 02:17:55.580608 6113 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:55.581248 6113 heartbeater.cc:511] Master 127.26.189.190:39175 requested a full tablet report, sending...
I20260806 02:17:55.581254 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 5929
I20260806 02:17:55.581403 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:17:55.581879 27382 external_mini_cluster.cc:1428] Setting key 3befc6d3da5be5611c5037dd6ce50f05
I20260806 02:17:55.582468 5634 ts_manager.cc:194] Registered new tserver with Master: dc36ea51d2cb41cb914a292289ee8a2e (127.26.189.130:35503)
I20260806 02:17:55.583220 5634 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:59587
I20260806 02:17:55.591948 6121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.583145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39175 (local address 127.26.189.130:58253)
0806 02:17:55.583558 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:55.583574 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:55.583731 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:55.584022 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:55.584026 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:55.584291 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:55.584487 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.584499 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.585513 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.585520 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.586271 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.586281 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.586888 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.586890 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.586960 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.587493 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:55.587504 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:55.587845 (+ 341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:55.590080 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:55.590084 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:55.590086 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:55.590440 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:55.590768 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:55.590770 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:55.590772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:55.590857 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:55.591446 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:55.591449 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:55.591540 (+ 91us) client_negotiation.cc:769] Sending connection context
0806 02:17:55.591650 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 02:17:55.591782 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":202,"threads_started":1}
I20260806 02:17:55.592085 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.583227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:58253 (local address 127.26.189.190:39175)
0806 02:17:55.583540 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:55.583546 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:55.583657 (+ 111us) server_negotiation.cc:407] Connection header received
0806 02:17:55.583845 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:55.583850 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:55.583900 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:55.583985 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:55.584632 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.585363 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.586395 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.586767 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.586898 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.587988 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:55.587995 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:55.588001 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:55.588033 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:55.589910 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.590548 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.590555 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.590558 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.590660 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.590962 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.590968 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.590972 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.591301 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:55.591424 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:55.591746 (+ 322us) server_negotiation.cc:299] Negotiation successful
0806 02:17:55.591882 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239}
WARNING: no policy specified for oryx/127.26.189.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab.
Entry for principal oryx/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab.
I20260806 02:17:55.613965 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39175
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab
--principal=oryx/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:55.734653 6130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:55.734926 6130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:55.734972 6130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:55.739068 6130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:55.739144 6130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:55.739202 6130 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 02:17:55.739234 6130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:17:55.744841 6130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab
--principal=oryx/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.189.190:39175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:55.745868 6130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:55.746848 6130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:55.757010 6141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:55.757004 6137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:55.757014 6139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:55.757447 6130 server_base.cc:1034] running on GCE node
I20260806 02:17:55.757887 6130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:55.758570 6130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:55.759765 6130 hybrid_clock.cc:648] HybridClock initialized: now 1785982675759752 us; error 31 us; skew 500 ppm
Aug 06 02:17:55 dist-test-slave-gkw7 krb5kdc[5575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982675, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:55.762799 6130 init.cc:377] Logged in from keytab as oryx/127.26.189.131@KRBTEST.COM (short username oryx)
I20260806 02:17:55.763720 6130 webserver.cc:460] Webserver started at http://127.26.189.131:46411/ using document root <none> and password file <none>
I20260806 02:17:55.764310 6130 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:55.764411 6130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:55.764669 6130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:55.766857 6130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "dcc973a5b1454617b8a494428bcf5b0c"
format_stamp: "Formatted at 2026-08-06 02:17:55 on dist-test-slave-gkw7"
server_key: "bb0e1b6c03ad13491372b1fa6656cd72"
server_key_iv: "c15da4b930bb39e31f96c3832e72197e"
server_key_version: "encryptionkey@0"
I20260806 02:17:55.767442 6130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "dcc973a5b1454617b8a494428bcf5b0c"
format_stamp: "Formatted at 2026-08-06 02:17:55 on dist-test-slave-gkw7"
server_key: "bb0e1b6c03ad13491372b1fa6656cd72"
server_key_iv: "c15da4b930bb39e31f96c3832e72197e"
server_key_version: "encryptionkey@0"
I20260806 02:17:55.771320 6130 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:17:55.773903 6148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:55.775323 6130 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:17:55.775483 6130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "dcc973a5b1454617b8a494428bcf5b0c"
format_stamp: "Formatted at 2026-08-06 02:17:55 on dist-test-slave-gkw7"
server_key: "bb0e1b6c03ad13491372b1fa6656cd72"
server_key_iv: "c15da4b930bb39e31f96c3832e72197e"
server_key_version: "encryptionkey@0"
I20260806 02:17:55.775609 6130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:55.796507 6130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:55.799930 6130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:55.800182 6130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:17:55.801831 6130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:17:55.801910 6130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:55.801985 6130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:17:55.802034 6130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 02:17:55 dist-test-slave-gkw7 krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982675, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:55.813516 6130 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:35499
I20260806 02:17:55.813585 6303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:35499 every 8 connection(s)
I20260806 02:17:55.814635 6130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:17:55.815855 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.802842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:35117 (local address 127.26.189.190:39175)
0806 02:17:55.803009 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:55.803015 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:55.804004 (+ 989us) server_negotiation.cc:407] Connection header received
0806 02:17:55.805210 (+ 1206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:55.805216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:55.805291 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:55.805408 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:55.806709 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.807299 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.808545 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.808875 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.809002 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.811779 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:55.811785 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:55.811789 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:55.811822 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:55.813692 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.814173 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.814177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.814178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.814277 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.814606 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.814612 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.814614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.814862 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:55.814985 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:55.815555 (+ 570us) server_negotiation.cc:299] Negotiation successful
0806 02:17:55.815701 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 02:17:55.816651 6162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.803303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39175 (local address 127.26.189.131:35117)
0806 02:17:55.803810 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:55.803862 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:55.804942 (+ 1080us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:55.805677 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:55.805686 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:55.806051 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:55.806543 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.806556 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.807457 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.807459 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.808396 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.808405 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.809057 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.809061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.809266 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.809998 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:55.810025 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:55.811578 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:55.813796 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:55.813801 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:55.813812 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:55.814064 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:55.814378 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:55.814380 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:55.814381 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:55.814504 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:55.814972 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:55.814977 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:55.815292 (+ 315us) client_negotiation.cc:769] Sending connection context
0806 02:17:55.815507 (+ 215us) client_negotiation.cc:240] Negotiation successful
0806 02:17:55.815783 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":137,"threads_started":1}
I20260806 02:17:55.817929 6305 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39175
I20260806 02:17:55.818094 6305 heartbeater.cc:464] Registering TS with master...
I20260806 02:17:55.818607 6305 heartbeater.cc:511] Master 127.26.189.190:39175 requested a full tablet report, sending...
I20260806 02:17:55.819748 5633 ts_manager.cc:194] Registered new tserver with Master: dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499)
I20260806 02:17:55.820576 5633 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:35117
I20260806 02:17:55.822176 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 6130
I20260806 02:17:55.822351 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:17:55.822781 27382 external_mini_cluster.cc:1428] Setting key 912431462987396339589bd04c7ce758
I20260806 02:17:55.825183 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:17:55.830232 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.820256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:57601 (local address 127.26.189.190:39175)
0806 02:17:55.820371 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:55.820376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:55.820602 (+ 226us) server_negotiation.cc:407] Connection header received
0806 02:17:55.820700 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:55.820706 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:55.820772 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:55.820890 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:55.821405 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.822001 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.822985 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.823286 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.823386 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.824810 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:55.824813 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:55.824815 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:55.824837 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:55.828474 (+ 3637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.828997 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.828999 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.829000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.829079 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.829387 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.829389 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.829390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.829620 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:55.829713 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:55.830022 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 02:17:55.830115 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 02:17:55.830487 6314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.820174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39175 (local address 127.26.189.131:57601)
0806 02:17:55.820473 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:55.820487 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:55.820597 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:55.820905 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:55.820908 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:55.821136 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:55.821273 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.821280 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.822131 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.822135 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.822875 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.822888 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.823530 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.823534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.823637 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.824214 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:55.824234 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:55.824659 (+ 425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:55.828596 (+ 3937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:55.828602 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:55.828607 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:55.828891 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:55.829176 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:55.829182 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:55.829187 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:55.829294 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:55.829728 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:55.829734 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:55.829851 (+ 117us) client_negotiation.cc:769] Sending connection context
0806 02:17:55.829970 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 02:17:55.830161 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":92,"threads_started":1}
Aug 06 02:17:55 dist-test-slave-gkw7 krb5kdc[5575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982675, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 02:17:55 dist-test-slave-gkw7 krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:17:55 dist-test-slave-gkw7 krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 02:17:55.851117 5702 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:17:55.844676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50378 (local address 127.26.189.190:39175)
0806 02:17:55.844818 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:55.844822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:55.844833 (+ 11us) server_negotiation.cc:407] Connection header received
0806 02:17:55.844867 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:55.844870 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:55.844904 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:55.844999 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:55.845774 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.846305 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.847181 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.847437 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.847558 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.850945 (+ 3387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50378: BlockingRecv error: recv got EOF from 127.0.0.1:50378 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 06 02:17:55 dist-test-slave-gkw7 krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982675, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:55.860733 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.852553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50384 (local address 127.26.189.190:39175)
0806 02:17:55.852685 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:55.852688 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:55.852798 (+ 110us) server_negotiation.cc:407] Connection header received
0806 02:17:55.852888 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:55.852890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:55.852925 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:55.852990 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:55.853641 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.854126 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.855411 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.855618 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.855707 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.858135 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:55.858138 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:55.858140 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:55.858162 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:55.859367 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.859748 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.859751 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.859752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.859841 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:55.860072 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:55.860074 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:55.860075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:55.860234 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:55.860334 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:55.860518 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 02:17:55.860609 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 02:17:55.863855 5633 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50384:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:17:55.867280 5633 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:55.883922 6338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.877115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35318 (local address 127.26.189.130:35503)
0806 02:17:55.877558 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:55.877576 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:55.878393 (+ 817us) server_negotiation.cc:407] Connection header received
0806 02:17:55.878503 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:55.878509 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:55.878735 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:55.878937 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:55.879100 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.880210 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.882248 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.882933 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.883103 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.883296 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:55.883644 (+ 348us) server_negotiation.cc:299] Negotiation successful
0806 02:17:55.883761 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":116,"threads_started":1}
I20260806 02:17:55.884281 6343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.877828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42472 (local address 127.26.189.129:41683)
0806 02:17:55.878182 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:55.878192 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:55.878753 (+ 561us) server_negotiation.cc:407] Connection header received
0806 02:17:55.878881 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:55.878886 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:55.879088 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:55.879261 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:55.879520 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.880781 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.882261 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.883215 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.883448 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.883618 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:55.883974 (+ 356us) server_negotiation.cc:299] Negotiation successful
0806 02:17:55.884107 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":105,"threads_started":1}
I20260806 02:17:55.884316 6340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.876826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:35503 (local address 127.0.0.1:35318)
0806 02:17:55.878258 (+ 1432us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:55.878273 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:55.878373 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:55.878888 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:55.878891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:55.878906 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:55.878999 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.879008 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.880362 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.880366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.882090 (+ 1724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.882102 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.883077 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.883083 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.883200 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.883242 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 02:17:55.883360 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 02:17:55.883512 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1369,"mutex_wait_us":58,"thread_start_us":99,"threads_started":1}
I20260806 02:17:55.884959 6336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.877353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:41683 (local address 127.0.0.1:42472)
0806 02:17:55.878566 (+ 1213us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:55.878579 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:55.878657 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:55.879259 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:55.879262 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:55.879281 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:55.879376 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.879383 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.880890 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.880897 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.882130 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.882146 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.883700 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.883703 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.883790 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.883812 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 02:17:55.883933 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 02:17:55.884169 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1155,"thread_start_us":96,"threads_started":1}
I20260806 02:17:55.887228 6020 tablet_service.cc:1467] Processing CreateTablet for tablet ee7e7daf35ca400c9afbbeba4a96d97b (DEFAULT_TABLE table=test-table [id=df775a21117540d8a56946f3ff5c505f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:55.887635 5796 tablet_service.cc:1467] Processing CreateTablet for tablet ee7e7daf35ca400c9afbbeba4a96d97b (DEFAULT_TABLE table=test-table [id=df775a21117540d8a56946f3ff5c505f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:55.888383 6020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee7e7daf35ca400c9afbbeba4a96d97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:55.888881 6337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.876620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:35499 (local address 127.0.0.1:50712)
0806 02:17:55.877713 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:55.877766 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:55.877895 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:55.878731 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:55.878739 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:55.878762 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:55.878939 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.878946 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.880427 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.880430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.883416 (+ 2986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:55.883429 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.888460 (+ 5031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.888464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:55.888559 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.888585 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 02:17:55.888659 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 02:17:55.888749 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"mutex_wait_us":62,"thread_start_us":77,"threads_started":1}
I20260806 02:17:55.888892 5796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee7e7daf35ca400c9afbbeba4a96d97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:55.889304 6342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:55.877364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50712 (local address 127.26.189.131:35499)
0806 02:17:55.877778 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:55.877792 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:55.877827 (+ 35us) server_negotiation.cc:407] Connection header received
0806 02:17:55.878125 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:55.878133 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:55.878374 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:55.878530 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:55.879081 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.880326 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.883565 (+ 3239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:55.888096 (+ 4531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:55.888256 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:55.888382 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:55.889057 (+ 675us) server_negotiation.cc:299] Negotiation successful
0806 02:17:55.889163 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":134,"threads_started":1}
I20260806 02:17:55.892433 6211 tablet_service.cc:1467] Processing CreateTablet for tablet ee7e7daf35ca400c9afbbeba4a96d97b (DEFAULT_TABLE table=test-table [id=df775a21117540d8a56946f3ff5c505f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:55.893603 6211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee7e7daf35ca400c9afbbeba4a96d97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:55.896106 6345 tablet_bootstrap.cc:492] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c: Bootstrap starting.
I20260806 02:17:55.897867 6346 tablet_bootstrap.cc:492] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e: Bootstrap starting.
I20260806 02:17:55.898964 6345 tablet_bootstrap.cc:654] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:55.900022 6345 log.cc:824] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:55.900427 6346 tablet_bootstrap.cc:654] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:55.901007 6348 tablet_bootstrap.cc:492] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c: Bootstrap starting.
I20260806 02:17:55.901574 6346 log.cc:824] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:55.902606 6345 tablet_bootstrap.cc:492] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c: No bootstrap required, opened a new log
I20260806 02:17:55.902850 6345 ts_tablet_manager.cc:1397] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 02:17:55.903281 6348 tablet_bootstrap.cc:654] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:55.903973 6348 log.cc:824] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c: Log is configured to *not* fsync() on all Append() calls
I20260806 02:17:55.904004 6346 tablet_bootstrap.cc:492] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e: No bootstrap required, opened a new log
I20260806 02:17:55.904234 6346 ts_tablet_manager.cc:1397] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 02:17:55.906955 6348 tablet_bootstrap.cc:492] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c: No bootstrap required, opened a new log
I20260806 02:17:55.907680 6348 ts_tablet_manager.cc:1397] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 02:17:55.908337 6345 raft_consensus.cc:348] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } }
I20260806 02:17:55.908671 6345 raft_consensus.cc:374] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:55.908783 6345 raft_consensus.cc:729] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b6d37a2dcc4480f838a5c22e2a5e83c, State: Initialized, Role: FOLLOWER
I20260806 02:17:55.909047 6346 raft_consensus.cc:348] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } }
I20260806 02:17:55.909340 6346 raft_consensus.cc:374] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:55.909320 6345 consensus_queue.cc:260] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } }
I20260806 02:17:55.909451 6346 raft_consensus.cc:729] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc36ea51d2cb41cb914a292289ee8a2e, State: Initialized, Role: FOLLOWER
I20260806 02:17:55.909978 6346 consensus_queue.cc:260] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } }
I20260806 02:17:55.910599 6345 ts_tablet_manager.cc:1428] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260806 02:17:55.910770 6113 heartbeater.cc:503] Master 127.26.189.190:39175 was elected leader, sending a full tablet report...
I20260806 02:17:55.911096 6346 ts_tablet_manager.cc:1428] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 02:17:55.911118 5919 heartbeater.cc:503] Master 127.26.189.190:39175 was elected leader, sending a full tablet report...
I20260806 02:17:55.911373 6348 raft_consensus.cc:348] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } }
I20260806 02:17:55.911633 6348 raft_consensus.cc:374] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:55.911741 6348 raft_consensus.cc:729] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc973a5b1454617b8a494428bcf5b0c, State: Initialized, Role: FOLLOWER
I20260806 02:17:55.912153 6348 consensus_queue.cc:260] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } }
I20260806 02:17:55.912884 6305 heartbeater.cc:503] Master 127.26.189.190:39175 was elected leader, sending a full tablet report...
I20260806 02:17:55.913272 6348 ts_tablet_manager.cc:1428] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 02:17:56.030534 6356 raft_consensus.cc:482] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:56.030761 6356 raft_consensus.cc:504] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } }
I20260806 02:17:56.031985 6356 leader_election.cc:288] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499), 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683)
I20260806 02:17:56.036405 5964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.032212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:35499 (local address 127.26.189.130:37835)
0806 02:17:56.032403 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.032419 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:56.032513 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:56.032856 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:56.032859 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:56.032888 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:56.033027 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.033037 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.034088 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.034092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.035059 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.035068 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.035891 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.035895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.036016 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.036041 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 02:17:56.036121 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 02:17:56.036233 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107}
I20260806 02:17:56.036445 6342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.032344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:37835 (local address 127.26.189.131:35499)
0806 02:17:56.032477 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.032481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.032496 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:17:56.032669 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.032673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.032730 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.032814 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:56.033158 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.033968 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.035196 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.035767 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.035866 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.035908 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.036196 (+ 288us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.036312 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 02:17:56.036897 6343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.032457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:41235 (local address 127.26.189.129:41683)
0806 02:17:56.032597 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.032601 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.032825 (+ 224us) server_negotiation.cc:407] Connection header received
0806 02:17:56.032911 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.032914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.032960 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.033048 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:56.033778 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.034475 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.035669 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.036242 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.036356 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.036402 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.036641 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.036757 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 02:17:56.037236 6358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.032275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:41683 (local address 127.26.189.130:41235)
0806 02:17:56.032718 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.032731 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:56.032825 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:56.033082 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:56.033106 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:56.033131 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:56.033633 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.033644 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.034603 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.034606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.035525 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.035535 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.036362 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.036366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.036475 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.036499 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 02:17:56.037060 (+ 561us) client_negotiation.cc:240] Negotiation successful
0806 02:17:56.037134 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":134,"threads_started":1}
I20260806 02:17:56.037192 6239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee7e7daf35ca400c9afbbeba4a96d97b" candidate_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc973a5b1454617b8a494428bcf5b0c" is_pre_election: true
I20260806 02:17:56.037520 6239 raft_consensus.cc:2454] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc36ea51d2cb41cb914a292289ee8a2e in term 0.
I20260806 02:17:56.037930 5845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee7e7daf35ca400c9afbbeba4a96d97b" candidate_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" is_pre_election: true
I20260806 02:17:56.038079 5957 leader_election.cc:302] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc36ea51d2cb41cb914a292289ee8a2e, dcc973a5b1454617b8a494428bcf5b0c; no voters:
I20260806 02:17:56.038223 5845 raft_consensus.cc:2454] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc36ea51d2cb41cb914a292289ee8a2e in term 0.
I20260806 02:17:56.038410 6356 raft_consensus.cc:2781] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:56.038487 6356 raft_consensus.cc:482] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:56.038542 6356 raft_consensus.cc:3037] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.039865 6356 raft_consensus.cc:504] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } }
I20260806 02:17:56.040268 6356 leader_election.cc:288] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [CANDIDATE]: Term 1 election: Requested vote from peers dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499), 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683)
I20260806 02:17:56.040660 6239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee7e7daf35ca400c9afbbeba4a96d97b" candidate_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc973a5b1454617b8a494428bcf5b0c"
I20260806 02:17:56.040750 5845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee7e7daf35ca400c9afbbeba4a96d97b" candidate_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c"
I20260806 02:17:56.040797 6239 raft_consensus.cc:3037] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.040867 5845 raft_consensus.cc:3037] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.042217 5845 raft_consensus.cc:2454] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc36ea51d2cb41cb914a292289ee8a2e in term 1.
I20260806 02:17:56.042217 6239 raft_consensus.cc:2454] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc36ea51d2cb41cb914a292289ee8a2e in term 1.
I20260806 02:17:56.042496 5957 leader_election.cc:302] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc36ea51d2cb41cb914a292289ee8a2e, dcc973a5b1454617b8a494428bcf5b0c; no voters:
I20260806 02:17:56.042681 6356 raft_consensus.cc:2781] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:56.042870 6356 raft_consensus.cc:686] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 1 LEADER]: Becoming Leader. State: Replica: dc36ea51d2cb41cb914a292289ee8a2e, State: Running, Role: LEADER
I20260806 02:17:56.043215 6356 consensus_queue.cc:237] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } }
I20260806 02:17:56.046623 5633 catalog_manager.cc:5495] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e reported cstate change: term changed from 0 to 1, leader changed from <none> to dc36ea51d2cb41cb914a292289ee8a2e (127.26.189.130). New cstate: current_term: 1 leader_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } health_report { overall_health: UNKNOWN } } }
W20260806 02:17:56.066004 6308 tablet.cc:2369] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:17:56.075935 6338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.072208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35322 (local address 127.26.189.130:35503)
0806 02:17:56.072380 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.072386 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.072399 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:17:56.072485 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.072487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.072542 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.072680 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:56.072932 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.073462 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.074399 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.074632 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.074760 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.075066 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.075515 (+ 449us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.075669 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.075714 (+ 45us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.075779 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260806 02:17:56.076682 6114 tablet.cc:2369] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:17:56.082269 5845 raft_consensus.cc:1261] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Refusing update from remote peer dc36ea51d2cb41cb914a292289ee8a2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:56.082269 6239 raft_consensus.cc:1261] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Refusing update from remote peer dc36ea51d2cb41cb914a292289ee8a2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:56.083006 6356 consensus_queue.cc:1035] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:56.083186 6359 consensus_queue.cc:1035] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 02:17:56.086162 5920 tablet.cc:2369] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:17:56.095077 6364 mvcc.cc:205] Tried to move back new op lower bound from 7315385041224523776 to 7315385041076142080. Current Snapshot: MvccSnapshot[applied={T|T < 7315385041224523776 or (T in {7315385041224523776})}]
I20260806 02:17:56.101756 5632 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:56.101946 5632 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:56.104658 5632 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc: Sending DeleteTablet for 3 replicas of tablet ee7e7daf35ca400c9afbbeba4a96d97b
I20260806 02:17:56.105574 6211 tablet_service.cc:1514] Processing DeleteTablet for tablet ee7e7daf35ca400c9afbbeba4a96d97b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:56 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:50712
I20260806 02:17:56.105798 6020 tablet_service.cc:1514] Processing DeleteTablet for tablet ee7e7daf35ca400c9afbbeba4a96d97b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:56 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:35318
I20260806 02:17:56.106247 6377 tablet_replica.cc:330] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e: stopping tablet replica
I20260806 02:17:56.106274 5796 tablet_service.cc:1514] Processing DeleteTablet for tablet ee7e7daf35ca400c9afbbeba4a96d97b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:56 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:42472
I20260806 02:17:56.106271 5632 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50384:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 02:17:56.106595 6377 raft_consensus.cc:2229] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 1 LEADER]: Raft consensus shutting down.
W20260806 02:17:56.106731 5632 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:56.107064 6377 raft_consensus.cc:2258] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:56.107098 6378 tablet_replica.cc:330] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c: stopping tablet replica
I20260806 02:17:56.107568 6378 raft_consensus.cc:2229] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:56.107950 6378 raft_consensus.cc:2258] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:56.108448 6376 tablet_replica.cc:330] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c: stopping tablet replica
I20260806 02:17:56.108793 6376 raft_consensus.cc:2229] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:56.108822 6377 ts_tablet_manager.cc:1905] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:56.109172 6376 raft_consensus.cc:2258] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:56.110730 6376 ts_tablet_manager.cc:1905] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:56.112043 6377 ts_tablet_manager.cc:1918] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:56.112159 6377 log.cc:1196] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/ee7e7daf35ca400c9afbbeba4a96d97b
I20260806 02:17:56.112497 6377 ts_tablet_manager.cc:1939] T ee7e7daf35ca400c9afbbeba4a96d97b P dc36ea51d2cb41cb914a292289ee8a2e: Deleting consensus metadata
I20260806 02:17:56.112577 6211 tablet_service.cc:1467] Processing CreateTablet for tablet 75e782e844b0493d97117a25b63a920f (DEFAULT_TABLE table=test-table [id=d1b21db557ea4915a22a4fe5bd642908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:56.112728 5796 tablet_service.cc:1467] Processing CreateTablet for tablet 75e782e844b0493d97117a25b63a920f (DEFAULT_TABLE table=test-table [id=d1b21db557ea4915a22a4fe5bd642908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:56.112838 6211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75e782e844b0493d97117a25b63a920f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:56.112985 5796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75e782e844b0493d97117a25b63a920f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:56.113816 5612 catalog_manager.cc:4841] TS dc36ea51d2cb41cb914a292289ee8a2e (127.26.189.130:35503): tablet ee7e7daf35ca400c9afbbeba4a96d97b (table test-table [id=df775a21117540d8a56946f3ff5c505f]) successfully deleted
I20260806 02:17:56.114243 6020 tablet_service.cc:1467] Processing CreateTablet for tablet 75e782e844b0493d97117a25b63a920f (DEFAULT_TABLE table=test-table [id=d1b21db557ea4915a22a4fe5bd642908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:56.114501 6020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75e782e844b0493d97117a25b63a920f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:56.115572 6348 tablet_bootstrap.cc:492] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c: Bootstrap starting.
I20260806 02:17:56.116602 6348 tablet_bootstrap.cc:654] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:56.116742 6346 tablet_bootstrap.cc:492] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e: Bootstrap starting.
I20260806 02:17:56.117240 6345 tablet_bootstrap.cc:492] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c: Bootstrap starting.
I20260806 02:17:56.117980 6346 tablet_bootstrap.cc:654] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:56.118315 6345 tablet_bootstrap.cc:654] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:56.119294 6378 ts_tablet_manager.cc:1905] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:56.119320 6376 ts_tablet_manager.cc:1918] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:56.119557 6376 log.cc:1196] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/ee7e7daf35ca400c9afbbeba4a96d97b
I20260806 02:17:56.119875 6348 tablet_bootstrap.cc:492] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c: No bootstrap required, opened a new log
I20260806 02:17:56.119975 6348 ts_tablet_manager.cc:1397] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 02:17:56.120057 6376 ts_tablet_manager.cc:1939] T ee7e7daf35ca400c9afbbeba4a96d97b P dcc973a5b1454617b8a494428bcf5b0c: Deleting consensus metadata
I20260806 02:17:56.120491 6348 raft_consensus.cc:348] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.120604 6348 raft_consensus.cc:374] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:56.120646 6348 raft_consensus.cc:729] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc973a5b1454617b8a494428bcf5b0c, State: Initialized, Role: FOLLOWER
I20260806 02:17:56.120779 6348 consensus_queue.cc:260] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.121027 6348 ts_tablet_manager.cc:1428] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:56.121703 5614 catalog_manager.cc:4841] TS dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499): tablet ee7e7daf35ca400c9afbbeba4a96d97b (table test-table [id=df775a21117540d8a56946f3ff5c505f]) successfully deleted
I20260806 02:17:56.123376 6345 tablet_bootstrap.cc:492] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c: No bootstrap required, opened a new log
I20260806 02:17:56.123497 6345 ts_tablet_manager.cc:1397] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260806 02:17:56.123935 6345 raft_consensus.cc:348] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.124063 6345 raft_consensus.cc:374] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:56.124075 6378 ts_tablet_manager.cc:1918] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:56.124107 6345 raft_consensus.cc:729] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b6d37a2dcc4480f838a5c22e2a5e83c, State: Initialized, Role: FOLLOWER
I20260806 02:17:56.124279 6345 consensus_queue.cc:260] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.124573 6345 ts_tablet_manager.cc:1428] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:56.124658 6346 tablet_bootstrap.cc:492] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e: No bootstrap required, opened a new log
I20260806 02:17:56.124755 6346 ts_tablet_manager.cc:1397] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260806 02:17:56.125473 6346 raft_consensus.cc:348] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.125643 6346 raft_consensus.cc:374] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:56.125696 6346 raft_consensus.cc:729] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc36ea51d2cb41cb914a292289ee8a2e, State: Initialized, Role: FOLLOWER
I20260806 02:17:56.125852 6346 consensus_queue.cc:260] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.125919 6378 log.cc:1196] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/wal/wals/ee7e7daf35ca400c9afbbeba4a96d97b
I20260806 02:17:56.126181 6346 ts_tablet_manager.cc:1428] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 02:17:56.126303 6378 ts_tablet_manager.cc:1939] T ee7e7daf35ca400c9afbbeba4a96d97b P 6b6d37a2dcc4480f838a5c22e2a5e83c: Deleting consensus metadata
I20260806 02:17:56.127795 5612 catalog_manager.cc:4841] TS 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683): tablet ee7e7daf35ca400c9afbbeba4a96d97b (table test-table [id=df775a21117540d8a56946f3ff5c505f]) successfully deleted
I20260806 02:17:56.251854 6357 raft_consensus.cc:482] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:56.252030 6357 raft_consensus.cc:504] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.253315 6357 leader_election.cc:288] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683), dc36ea51d2cb41cb914a292289ee8a2e (127.26.189.130:35503)
I20260806 02:17:56.258045 6343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.253680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:41779 (local address 127.26.189.129:41683)
0806 02:17:56.253864 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.253868 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.254080 (+ 212us) server_negotiation.cc:407] Connection header received
0806 02:17:56.254156 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.254159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.254205 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.254276 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:56.254600 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.255292 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.256777 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.257383 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.257506 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.257584 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.257844 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.257919 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 02:17:56.258045 6162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.253559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:41683 (local address 127.26.189.131:41779)
0806 02:17:56.253860 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.253878 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:56.253991 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:56.254305 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:56.254312 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:56.254340 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:56.254484 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.254493 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.255413 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.255417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.256625 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.256638 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.257551 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.257556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.257660 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.257724 (+ 64us) client_negotiation.cc:769] Sending connection context
0806 02:17:56.257820 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 02:17:56.257901 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":1}
I20260806 02:17:56.258208 6338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.254063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:60521 (local address 127.26.189.130:35503)
0806 02:17:56.254204 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.254208 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.254358 (+ 150us) server_negotiation.cc:407] Connection header received
0806 02:17:56.254554 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.254557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.254611 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.254689 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:56.255015 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.255672 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.257028 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.257435 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.257597 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.257654 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.257989 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.258064 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 02:17:56.258616 6386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.253906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:35503 (local address 127.26.189.131:60521)
0806 02:17:56.254269 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.254282 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:56.254417 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:56.254729 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:56.254732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:56.254751 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:56.254886 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.254892 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.255807 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.255810 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.256900 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.256908 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.257685 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.257689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.257830 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.257853 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 02:17:56.257972 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 02:17:56.258044 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":28,"thread_start_us":97,"threads_started":1}
I20260806 02:17:56.258648 5845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e782e844b0493d97117a25b63a920f" candidate_uuid: "dcc973a5b1454617b8a494428bcf5b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" is_pre_election: true
I20260806 02:17:56.258806 5845 raft_consensus.cc:2454] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc973a5b1454617b8a494428bcf5b0c in term 0.
I20260806 02:17:56.259169 6044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e782e844b0493d97117a25b63a920f" candidate_uuid: "dcc973a5b1454617b8a494428bcf5b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" is_pre_election: true
I20260806 02:17:56.259253 6151 leader_election.cc:302] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6d37a2dcc4480f838a5c22e2a5e83c, dcc973a5b1454617b8a494428bcf5b0c; no voters:
I20260806 02:17:56.259398 6044 raft_consensus.cc:2454] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcc973a5b1454617b8a494428bcf5b0c in term 0.
I20260806 02:17:56.259593 6357 raft_consensus.cc:2781] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:56.259683 6357 raft_consensus.cc:482] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:56.259733 6357 raft_consensus.cc:3037] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.260797 6357 raft_consensus.cc:504] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.261185 6357 leader_election.cc:288] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [CANDIDATE]: Term 1 election: Requested vote from peers 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683), dc36ea51d2cb41cb914a292289ee8a2e (127.26.189.130:35503)
I20260806 02:17:56.261644 6044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e782e844b0493d97117a25b63a920f" candidate_uuid: "dcc973a5b1454617b8a494428bcf5b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc36ea51d2cb41cb914a292289ee8a2e"
I20260806 02:17:56.261646 5845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75e782e844b0493d97117a25b63a920f" candidate_uuid: "dcc973a5b1454617b8a494428bcf5b0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c"
I20260806 02:17:56.261776 6044 raft_consensus.cc:3037] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.261776 5845 raft_consensus.cc:3037] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.262996 6044 raft_consensus.cc:2454] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc973a5b1454617b8a494428bcf5b0c in term 1.
I20260806 02:17:56.262996 5845 raft_consensus.cc:2454] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcc973a5b1454617b8a494428bcf5b0c in term 1.
I20260806 02:17:56.263357 6151 leader_election.cc:302] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6d37a2dcc4480f838a5c22e2a5e83c, dcc973a5b1454617b8a494428bcf5b0c; no voters:
I20260806 02:17:56.263577 6357 raft_consensus.cc:2781] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:56.263854 6357 raft_consensus.cc:686] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 1 LEADER]: Becoming Leader. State: Replica: dcc973a5b1454617b8a494428bcf5b0c, State: Running, Role: LEADER
I20260806 02:17:56.264158 6357 consensus_queue.cc:237] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.266712 5634 catalog_manager.cc:5495] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c reported cstate change: term changed from 0 to 1, leader changed from <none> to dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131). New cstate: current_term: 1 leader_uuid: "dcc973a5b1454617b8a494428bcf5b0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } health_report { overall_health: HEALTHY } } }
Aug 06 02:17:56 dist-test-slave-gkw7 krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982674, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.190@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:56.304576 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.295676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59608 (local address 127.26.189.190:39175)
0806 02:17:56.295871 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.295876 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.296045 (+ 169us) server_negotiation.cc:407] Connection header received
0806 02:17:56.296228 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.296230 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.296295 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.296390 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:56.297098 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.297706 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.298517 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.298743 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.298858 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.301195 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:56.301198 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:56.301200 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:56.301225 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:56.302641 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:56.303141 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:56.303144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:56.303145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:56.303230 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:56.303600 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:56.303603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:56.303605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:56.303800 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:56.303883 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.304331 (+ 448us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.304438 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 02:17:56.304615 6396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.295515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39175 (local address 127.0.0.1:59608)
0806 02:17:56.295935 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.295948 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:56.296110 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:56.296408 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:56.296411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:56.296865 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:17:56.296962 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.296969 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.297814 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.297820 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.298387 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.298395 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.298862 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.298865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.298949 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.299544 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:17:56.299555 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:17:56.301041 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:17:56.302748 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:56.302757 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:56.302762 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:56.302996 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:56.303382 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:17:56.303385 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:17:56.303387 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:17:56.303483 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:17:56.303931 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:17:56.303943 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:17:56.304126 (+ 183us) client_negotiation.cc:769] Sending connection context
0806 02:17:56.304242 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 02:17:56.304372 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":161,"threads_started":1}
I20260806 02:17:56.308688 5634 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:59608:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 02:17:56.309460 5634 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:56.314363 6020 tablet_service.cc:1467] Processing CreateTablet for tablet a457b5ba1215459cb14ede653faf6eec (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3216bd3d03e14b94913d41eef545a77f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 02:17:56.314371 5796 tablet_service.cc:1467] Processing CreateTablet for tablet a457b5ba1215459cb14ede653faf6eec (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3216bd3d03e14b94913d41eef545a77f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 02:17:56.314483 6211 tablet_service.cc:1467] Processing CreateTablet for tablet a457b5ba1215459cb14ede653faf6eec (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3216bd3d03e14b94913d41eef545a77f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 02:17:56.314813 6211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a457b5ba1215459cb14ede653faf6eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:56.314813 5796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a457b5ba1215459cb14ede653faf6eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:56.314831 6020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a457b5ba1215459cb14ede653faf6eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:56.317335 6346 tablet_bootstrap.cc:492] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: Bootstrap starting.
I20260806 02:17:56.318276 6346 tablet_bootstrap.cc:654] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:56.318643 6345 tablet_bootstrap.cc:492] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c: Bootstrap starting.
I20260806 02:17:56.319655 6346 tablet_bootstrap.cc:492] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: No bootstrap required, opened a new log
I20260806 02:17:56.319751 6346 ts_tablet_manager.cc:1397] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 02:17:56.320060 6345 tablet_bootstrap.cc:654] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:56.320164 6346 raft_consensus.cc:348] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.320299 6346 raft_consensus.cc:374] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:56.320338 6346 raft_consensus.cc:729] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc36ea51d2cb41cb914a292289ee8a2e, State: Initialized, Role: FOLLOWER
I20260806 02:17:56.320470 6346 consensus_queue.cc:260] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.320763 6346 ts_tablet_manager.cc:1428] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:56.321094 6373 tablet_replica.cc:439] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } }
I20260806 02:17:56.321285 6373 tablet_replica.cc:442] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:56.321501 6348 tablet_bootstrap.cc:492] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c: Bootstrap starting.
I20260806 02:17:56.321661 6345 tablet_bootstrap.cc:492] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c: No bootstrap required, opened a new log
I20260806 02:17:56.321762 6345 ts_tablet_manager.cc:1397] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 02:17:56.322163 6345 raft_consensus.cc:348] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.322285 6345 raft_consensus.cc:374] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:56.322327 6345 raft_consensus.cc:729] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b6d37a2dcc4480f838a5c22e2a5e83c, State: Initialized, Role: FOLLOWER
I20260806 02:17:56.322467 6345 consensus_queue.cc:260] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.322649 6348 tablet_bootstrap.cc:654] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:56.322790 6345 ts_tablet_manager.cc:1428] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 02:17:56.322868 6353 tablet_replica.cc:439] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } }
I20260806 02:17:56.323011 6353 tablet_replica.cc:442] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:56.324012 6348 tablet_bootstrap.cc:492] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c: No bootstrap required, opened a new log
I20260806 02:17:56.324110 6348 ts_tablet_manager.cc:1397] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 02:17:56.324803 6348 raft_consensus.cc:348] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.324911 6348 raft_consensus.cc:374] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:56.324934 6348 raft_consensus.cc:729] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc973a5b1454617b8a494428bcf5b0c, State: Initialized, Role: FOLLOWER
I20260806 02:17:56.325062 6348 consensus_queue.cc:260] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.325295 6357 tablet_replica.cc:439] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } }
I20260806 02:17:56.325369 6348 ts_tablet_manager.cc:1428] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 02:17:56.325429 6357 tablet_replica.cc:442] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:56.337365 6373 raft_consensus.cc:482] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:56.337472 6373 raft_consensus.cc:504] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.337956 6373 leader_election.cc:288] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683), dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499)
I20260806 02:17:56.338310 5845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a457b5ba1215459cb14ede653faf6eec" candidate_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" is_pre_election: true
I20260806 02:17:56.338439 5845 raft_consensus.cc:2454] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc36ea51d2cb41cb914a292289ee8a2e in term 0.
I20260806 02:17:56.338442 6239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a457b5ba1215459cb14ede653faf6eec" candidate_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc973a5b1454617b8a494428bcf5b0c" is_pre_election: true
I20260806 02:17:56.338591 6239 raft_consensus.cc:2454] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc36ea51d2cb41cb914a292289ee8a2e in term 0.
I20260806 02:17:56.338708 5952 leader_election.cc:302] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6d37a2dcc4480f838a5c22e2a5e83c, dc36ea51d2cb41cb914a292289ee8a2e; no voters:
I20260806 02:17:56.338902 6373 raft_consensus.cc:2781] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:56.338994 6373 raft_consensus.cc:482] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:56.339044 6373 raft_consensus.cc:3037] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.340368 6373 raft_consensus.cc:504] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.340734 6373 leader_election.cc:288] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [CANDIDATE]: Term 1 election: Requested vote from peers 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683), dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499)
I20260806 02:17:56.340986 5845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a457b5ba1215459cb14ede653faf6eec" candidate_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c"
I20260806 02:17:56.341092 5845 raft_consensus.cc:3037] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.341131 6239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a457b5ba1215459cb14ede653faf6eec" candidate_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc973a5b1454617b8a494428bcf5b0c"
I20260806 02:17:56.341233 6239 raft_consensus.cc:3037] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.342206 5845 raft_consensus.cc:2454] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc36ea51d2cb41cb914a292289ee8a2e in term 1.
I20260806 02:17:56.342382 6239 raft_consensus.cc:2454] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc36ea51d2cb41cb914a292289ee8a2e in term 1.
I20260806 02:17:56.342530 5952 leader_election.cc:302] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6d37a2dcc4480f838a5c22e2a5e83c, dc36ea51d2cb41cb914a292289ee8a2e; no voters:
I20260806 02:17:56.342739 6373 raft_consensus.cc:2781] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:56.342839 6373 raft_consensus.cc:686] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [term 1 LEADER]: Becoming Leader. State: Replica: dc36ea51d2cb41cb914a292289ee8a2e, State: Running, Role: LEADER
I20260806 02:17:56.342981 6373 consensus_queue.cc:237] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.343726 6356 tablet_replica.cc:439] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: TxnStatusTablet state changed. Reason: New leader dc36ea51d2cb41cb914a292289ee8a2e. Latest consensus state: current_term: 1 leader_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } }
I20260806 02:17:56.343830 6356 tablet_replica.cc:442] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: This TxnStatusTablet replica's current role is: LEADER
I20260806 02:17:56.344100 6406 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 02:17:56.344238 6406 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 02:17:56.344790 5632 catalog_manager.cc:5495] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e reported cstate change: term changed from 0 to 1, leader changed from <none> to dc36ea51d2cb41cb914a292289ee8a2e (127.26.189.130). New cstate: current_term: 1 leader_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260806 02:17:56.364766 6396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.361037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:35503 (local address 127.0.0.1:54890)
0806 02:17:56.361245 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.361262 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:56.361377 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:56.361700 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:56.361702 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:56.361709 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 02:17:56.361822 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.361827 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.362855 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.362857 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.363465 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.363473 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.364051 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.364053 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.364118 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.364189 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.364505 (+ 316us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.364525 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 02:17:56.364582 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 02:17:56.364648 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 02:17:56.364822 6338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.361308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54890 (local address 127.26.189.130:35503)
0806 02:17:56.361444 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.361449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.361464 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:17:56.361514 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.361517 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.361587 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.361670 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:56.361942 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.362741 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.363578 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.363939 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.364045 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.364323 (+ 278us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.364406 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.364480 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.364623 (+ 143us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.364683 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 02:17:56.367558 5845 raft_consensus.cc:1261] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Refusing update from remote peer dc36ea51d2cb41cb914a292289ee8a2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:56.367578 6239 raft_consensus.cc:1261] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Refusing update from remote peer dc36ea51d2cb41cb914a292289ee8a2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:56.368058 6373 consensus_queue.cc:1035] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:56.368258 6356 consensus_queue.cc:1035] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:56.369781 6353 tablet_replica.cc:439] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c: TxnStatusTablet state changed. Reason: New leader dc36ea51d2cb41cb914a292289ee8a2e. Latest consensus state: current_term: 1 leader_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } }
I20260806 02:17:56.369803 6357 tablet_replica.cc:439] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c: TxnStatusTablet state changed. Reason: New leader dc36ea51d2cb41cb914a292289ee8a2e. Latest consensus state: current_term: 1 leader_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } }
I20260806 02:17:56.369900 6353 tablet_replica.cc:442] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:56.369901 6357 tablet_replica.cc:442] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:56.372114 6359 tablet_replica.cc:439] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } }
I20260806 02:17:56.372231 6359 tablet_replica.cc:442] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: This TxnStatusTablet replica's current role is: LEADER
I20260806 02:17:56.372875 6353 tablet_replica.cc:439] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } }
I20260806 02:17:56.372988 6353 tablet_replica.cc:442] T a457b5ba1215459cb14ede653faf6eec P 6b6d37a2dcc4480f838a5c22e2a5e83c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:56.373906 6362 mvcc.cc:205] Tried to move back new op lower bound from 7315385042397081600 to 7315385042302304256. Current Snapshot: MvccSnapshot[applied={T|T < 7315385042397081600 or (T in {7315385042397081600})}]
I20260806 02:17:56.378744 6373 tablet_replica.cc:439] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } }
I20260806 02:17:56.378861 6373 tablet_replica.cc:442] T a457b5ba1215459cb14ede653faf6eec P dc36ea51d2cb41cb914a292289ee8a2e: This TxnStatusTablet replica's current role is: LEADER
I20260806 02:17:56.379894 6357 tablet_replica.cc:439] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } } }
I20260806 02:17:56.380019 6357 tablet_replica.cc:442] T a457b5ba1215459cb14ede653faf6eec P dcc973a5b1454617b8a494428bcf5b0c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 02:17:56.382663 6342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.376586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52878 (local address 127.26.189.131:35499)
0806 02:17:56.376728 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.376733 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.376748 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:17:56.376866 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.376869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.376932 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.377042 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:56.377282 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.378163 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.379366 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.379706 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.379821 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.381508 (+ 1687us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.382196 (+ 688us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.382314 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.382361 (+ 47us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.382419 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 02:17:56.393635 6415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.390086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:35503 (local address 127.26.189.131:50815)
0806 02:17:56.390382 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.390403 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:56.390536 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:56.390807 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:56.390810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:56.390818 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 02:17:56.390944 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.390950 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.391673 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.391679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.392336 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.392345 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.392822 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.392825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.392929 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.392974 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.393287 (+ 313us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.393296 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 02:17:56.393361 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 02:17:56.393438 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":83,"threads_started":1}
I20260806 02:17:56.393613 6338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.390202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:50815 (local address 127.26.189.130:35503)
0806 02:17:56.390353 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.390358 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.390478 (+ 120us) server_negotiation.cc:407] Connection header received
0806 02:17:56.390641 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.390644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.390710 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.390794 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:56.391056 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.391559 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.392468 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.392703 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.392818 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.393120 (+ 302us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.393198 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.393282 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.393371 (+ 89us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.393426 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 02:17:56.401631 5845 raft_consensus.cc:1261] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Refusing update from remote peer dcc973a5b1454617b8a494428bcf5b0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:56.401836 6044 raft_consensus.cc:1261] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Refusing update from remote peer dcc973a5b1454617b8a494428bcf5b0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:56.402189 6357 consensus_queue.cc:1035] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:56.402415 6387 consensus_queue.cc:1035] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:56.406126 6363 mvcc.cc:205] Tried to move back new op lower bound from 7315385042536464384 to 7315385041980583936. Current Snapshot: MvccSnapshot[applied={T|T < 7315385042536464384}]
I20260806 02:17:56.425735 6342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.422167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:37415 (local address 127.26.189.131:35499)
0806 02:17:56.422279 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.422284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.422297 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:17:56.422345 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.422347 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.422395 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.422476 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:56.422796 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.423572 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.424461 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.424812 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.424918 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.425235 (+ 317us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.425321 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.425395 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.425509 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.425584 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 02:17:56.425737 6426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.421716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:35499 (local address 127.26.189.130:37415)
0806 02:17:56.422113 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.422130 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:56.422233 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:56.422520 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:56.422523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:56.422532 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 02:17:56.422673 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.422680 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.423689 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.423692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.424335 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.424343 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.424929 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.424931 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.425031 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.425086 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.425406 (+ 320us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.425415 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 02:17:56.425490 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 02:17:56.425595 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":156,"threads_started":1}
I20260806 02:17:56.455849 5632 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:56.456024 5632 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50384:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:56.458537 5632 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc: Sending DeleteTablet for 3 replicas of tablet 75e782e844b0493d97117a25b63a920f
I20260806 02:17:56.459224 6020 tablet_service.cc:1514] Processing DeleteTablet for tablet 75e782e844b0493d97117a25b63a920f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:56 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:35318
I20260806 02:17:56.459470 6211 tablet_service.cc:1514] Processing DeleteTablet for tablet 75e782e844b0493d97117a25b63a920f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:56 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:50712
I20260806 02:17:56.459473 5796 tablet_service.cc:1514] Processing DeleteTablet for tablet 75e782e844b0493d97117a25b63a920f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:56 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:42472
I20260806 02:17:56.459694 6378 tablet_replica.cc:330] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c: stopping tablet replica
I20260806 02:17:56.459722 6377 tablet_replica.cc:330] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e: stopping tablet replica
I20260806 02:17:56.459846 6378 raft_consensus.cc:2229] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:56.459851 6377 raft_consensus.cc:2229] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:56.459961 6378 raft_consensus.cc:2258] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:56.459969 6377 raft_consensus.cc:2258] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:56.460145 6376 tablet_replica.cc:330] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c: stopping tablet replica
I20260806 02:17:56.460253 6376 raft_consensus.cc:2229] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:17:56.460557 6376 raft_consensus.cc:2258] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:56.461678 6377 ts_tablet_manager.cc:1905] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:56.461730 6378 ts_tablet_manager.cc:1905] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:56.464856 6378 ts_tablet_manager.cc:1918] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:56.464932 6378 log.cc:1196] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/wal/wals/75e782e844b0493d97117a25b63a920f
I20260806 02:17:56.464983 6377 ts_tablet_manager.cc:1918] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:56.465055 6377 log.cc:1196] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/75e782e844b0493d97117a25b63a920f
I20260806 02:17:56.465209 6378 ts_tablet_manager.cc:1939] T 75e782e844b0493d97117a25b63a920f P 6b6d37a2dcc4480f838a5c22e2a5e83c: Deleting consensus metadata
I20260806 02:17:56.465339 6377 ts_tablet_manager.cc:1939] T 75e782e844b0493d97117a25b63a920f P dc36ea51d2cb41cb914a292289ee8a2e: Deleting consensus metadata
I20260806 02:17:56.466331 6376 ts_tablet_manager.cc:1905] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:56.469105 6376 ts_tablet_manager.cc:1918] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:56.469189 6376 log.cc:1196] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/75e782e844b0493d97117a25b63a920f
I20260806 02:17:56.469453 6376 ts_tablet_manager.cc:1939] T 75e782e844b0493d97117a25b63a920f P dcc973a5b1454617b8a494428bcf5b0c: Deleting consensus metadata
I20260806 02:17:56.469640 5612 catalog_manager.cc:4841] TS dc36ea51d2cb41cb914a292289ee8a2e (127.26.189.130:35503): tablet 75e782e844b0493d97117a25b63a920f (table test-table [id=d1b21db557ea4915a22a4fe5bd642908]) successfully deleted
I20260806 02:17:56.473047 5614 catalog_manager.cc:4841] TS dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499): tablet 75e782e844b0493d97117a25b63a920f (table test-table [id=d1b21db557ea4915a22a4fe5bd642908]) successfully deleted
I20260806 02:17:56.474920 5612 catalog_manager.cc:4841] TS 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683): tablet 75e782e844b0493d97117a25b63a920f (table test-table [id=d1b21db557ea4915a22a4fe5bd642908]) successfully deleted
Aug 06 02:17:56 dist-test-slave-gkw7 krb5kdc[5575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 02:17:56 dist-test-slave-gkw7 krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:17:56 dist-test-slave-gkw7 krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 02:17:56.505105 5702 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:17:56.496861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59614 (local address 127.26.189.190:39175)
0806 02:17:56.496995 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.497000 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.497314 (+ 314us) server_negotiation.cc:407] Connection header received
0806 02:17:56.497435 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.497439 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.497499 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.497673 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:56.498541 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.499389 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.500618 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.500981 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.501092 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.504965 (+ 3873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59614: BlockingRecv error: recv got EOF from 127.0.0.1:59614 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 02:17:56 dist-test-slave-gkw7 krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM
I20260806 02:17:56.517778 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.507363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59620 (local address 127.26.189.190:39175)
0806 02:17:56.507475 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.507480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.507608 (+ 128us) server_negotiation.cc:407] Connection header received
0806 02:17:56.507743 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.507748 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.507796 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.507884 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:17:56.508611 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.509491 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.510746 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.511108 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.511211 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.514155 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:17:56.514160 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:17:56.514163 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:17:56.514192 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:17:56.515900 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:56.516400 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:56.516404 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:56.516406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:56.516498 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:17:56.516811 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:17:56.516814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:17:56.516816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:17:56.517041 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:17:56.517180 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.517436 (+ 256us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.517592 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 02:17:56.520831 5632 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59620:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:17:56.521339 5632 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:56.526501 5796 tablet_service.cc:1467] Processing CreateTablet for tablet b8de7c84c75e46f19b5919d240f4cef4 (DEFAULT_TABLE table=test-table [id=61dd8ccbf0544093ad5a40395ea40b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:56.526563 6020 tablet_service.cc:1467] Processing CreateTablet for tablet b8de7c84c75e46f19b5919d240f4cef4 (DEFAULT_TABLE table=test-table [id=61dd8ccbf0544093ad5a40395ea40b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:56.526841 5796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8de7c84c75e46f19b5919d240f4cef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:56.526904 6020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8de7c84c75e46f19b5919d240f4cef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:56.528960 6346 tablet_bootstrap.cc:492] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e: Bootstrap starting.
I20260806 02:17:56.529457 6345 tablet_bootstrap.cc:492] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c: Bootstrap starting.
I20260806 02:17:56.530001 6346 tablet_bootstrap.cc:654] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:56.530366 6345 tablet_bootstrap.cc:654] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:56.531127 6211 tablet_service.cc:1467] Processing CreateTablet for tablet b8de7c84c75e46f19b5919d240f4cef4 (DEFAULT_TABLE table=test-table [id=61dd8ccbf0544093ad5a40395ea40b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:56.531401 6211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8de7c84c75e46f19b5919d240f4cef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:56.531745 6345 tablet_bootstrap.cc:492] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c: No bootstrap required, opened a new log
I20260806 02:17:56.531862 6345 ts_tablet_manager.cc:1397] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 02:17:56.532428 6345 raft_consensus.cc:348] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.532549 6345 raft_consensus.cc:374] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:56.532591 6345 raft_consensus.cc:729] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b6d37a2dcc4480f838a5c22e2a5e83c, State: Initialized, Role: FOLLOWER
I20260806 02:17:56.532738 6345 consensus_queue.cc:260] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.533772 6348 tablet_bootstrap.cc:492] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c: Bootstrap starting.
I20260806 02:17:56.534058 6345 ts_tablet_manager.cc:1428] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260806 02:17:56.534721 6348 tablet_bootstrap.cc:654] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:56.535847 6348 tablet_bootstrap.cc:492] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c: No bootstrap required, opened a new log
I20260806 02:17:56.535972 6348 ts_tablet_manager.cc:1397] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 02:17:56.536459 6348 raft_consensus.cc:348] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.536607 6348 raft_consensus.cc:374] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:56.536674 6348 raft_consensus.cc:729] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc973a5b1454617b8a494428bcf5b0c, State: Initialized, Role: FOLLOWER
I20260806 02:17:56.536824 6348 consensus_queue.cc:260] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.537103 6348 ts_tablet_manager.cc:1428] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 02:17:56.537166 6346 tablet_bootstrap.cc:492] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e: No bootstrap required, opened a new log
I20260806 02:17:56.537249 6346 ts_tablet_manager.cc:1397] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260806 02:17:56.538192 6346 raft_consensus.cc:348] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.538348 6346 raft_consensus.cc:374] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:56.538385 6346 raft_consensus.cc:729] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc36ea51d2cb41cb914a292289ee8a2e, State: Initialized, Role: FOLLOWER
I20260806 02:17:56.538518 6346 consensus_queue.cc:260] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.538805 6346 ts_tablet_manager.cc:1428] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 02:17:56.642316 6373 raft_consensus.cc:482] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:56.642513 6373 raft_consensus.cc:504] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.642972 6373 leader_election.cc:288] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683), dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499)
I20260806 02:17:56.643450 5845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8de7c84c75e46f19b5919d240f4cef4" candidate_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" is_pre_election: true
I20260806 02:17:56.643489 6239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8de7c84c75e46f19b5919d240f4cef4" candidate_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc973a5b1454617b8a494428bcf5b0c" is_pre_election: true
I20260806 02:17:56.643622 5845 raft_consensus.cc:2454] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc36ea51d2cb41cb914a292289ee8a2e in term 0.
I20260806 02:17:56.643658 6239 raft_consensus.cc:2454] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc36ea51d2cb41cb914a292289ee8a2e in term 0.
I20260806 02:17:56.643983 5952 leader_election.cc:302] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6d37a2dcc4480f838a5c22e2a5e83c, dc36ea51d2cb41cb914a292289ee8a2e; no voters:
I20260806 02:17:56.644183 6373 raft_consensus.cc:2781] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:56.644246 6373 raft_consensus.cc:482] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:56.644321 6373 raft_consensus.cc:3037] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.645381 6373 raft_consensus.cc:504] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.645817 6373 leader_election.cc:288] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [CANDIDATE]: Term 1 election: Requested vote from peers 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683), dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499)
I20260806 02:17:56.646239 5845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8de7c84c75e46f19b5919d240f4cef4" candidate_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c"
I20260806 02:17:56.646397 5845 raft_consensus.cc:3037] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.646374 6239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8de7c84c75e46f19b5919d240f4cef4" candidate_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc973a5b1454617b8a494428bcf5b0c"
I20260806 02:17:56.646543 6239 raft_consensus.cc:3037] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.647393 5845 raft_consensus.cc:2454] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc36ea51d2cb41cb914a292289ee8a2e in term 1.
I20260806 02:17:56.647691 5952 leader_election.cc:302] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6d37a2dcc4480f838a5c22e2a5e83c, dc36ea51d2cb41cb914a292289ee8a2e; no voters:
I20260806 02:17:56.647886 6373 raft_consensus.cc:2781] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:56.647919 6239 raft_consensus.cc:2454] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc36ea51d2cb41cb914a292289ee8a2e in term 1.
I20260806 02:17:56.648032 6373 raft_consensus.cc:686] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 1 LEADER]: Becoming Leader. State: Replica: dc36ea51d2cb41cb914a292289ee8a2e, State: Running, Role: LEADER
I20260806 02:17:56.648178 6373 consensus_queue.cc:237] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.650046 5634 catalog_manager.cc:5495] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e reported cstate change: term changed from 0 to 1, leader changed from <none> to dc36ea51d2cb41cb914a292289ee8a2e (127.26.189.130). New cstate: current_term: 1 leader_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260806 02:17:56.662963 6338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.659726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54900 (local address 127.26.189.130:35503)
0806 02:17:56.659869 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.659873 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.659887 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:17:56.660019 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.660021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.660067 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.660171 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:56.660429 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.660942 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.661850 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.662107 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.662214 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.662483 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.662558 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.662624 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.662717 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.662762 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 02:17:56.665068 6239 raft_consensus.cc:1261] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Refusing update from remote peer dc36ea51d2cb41cb914a292289ee8a2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:56.665068 5845 raft_consensus.cc:1261] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Refusing update from remote peer dc36ea51d2cb41cb914a292289ee8a2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:56.665601 6373 consensus_queue.cc:1035] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:56.665813 6356 consensus_queue.cc:1035] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:56.674425 5632 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:56.674563 5632 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:56.676707 5632 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc: Sending DeleteTablet for 3 replicas of tablet b8de7c84c75e46f19b5919d240f4cef4
I20260806 02:17:56.677450 6020 tablet_service.cc:1514] Processing DeleteTablet for tablet b8de7c84c75e46f19b5919d240f4cef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:56 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:35318
I20260806 02:17:56.677492 5796 tablet_service.cc:1514] Processing DeleteTablet for tablet b8de7c84c75e46f19b5919d240f4cef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:56 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:42472
I20260806 02:17:56.677692 6377 tablet_replica.cc:330] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e: stopping tablet replica
I20260806 02:17:56.677706 6378 tablet_replica.cc:330] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c: stopping tablet replica
I20260806 02:17:56.677713 6211 tablet_service.cc:1514] Processing DeleteTablet for tablet b8de7c84c75e46f19b5919d240f4cef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:56 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:50712
I20260806 02:17:56.677824 6378 raft_consensus.cc:2229] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:56.677824 6377 raft_consensus.cc:2229] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:17:56.677947 6378 raft_consensus.cc:2258] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:56.677992 6377 raft_consensus.cc:2258] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:56.678115 6376 tablet_replica.cc:330] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c: stopping tablet replica
I20260806 02:17:56.678226 6376 raft_consensus.cc:2229] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:56.678320 6376 raft_consensus.cc:2258] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:56.679040 6377 ts_tablet_manager.cc:1905] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:56.678951 5632 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59620:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 02:17:56.679121 6376 ts_tablet_manager.cc:1905] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:56.679364 6378 ts_tablet_manager.cc:1905] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 02:17:56.679396 5632 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:17:56.681519 6376 ts_tablet_manager.cc:1918] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:56.681519 6377 ts_tablet_manager.cc:1918] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:56.681620 6376 log.cc:1196] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/b8de7c84c75e46f19b5919d240f4cef4
I20260806 02:17:56.681620 6377 log.cc:1196] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/b8de7c84c75e46f19b5919d240f4cef4
I20260806 02:17:56.681921 6377 ts_tablet_manager.cc:1939] T b8de7c84c75e46f19b5919d240f4cef4 P dc36ea51d2cb41cb914a292289ee8a2e: Deleting consensus metadata
I20260806 02:17:56.681921 6376 ts_tablet_manager.cc:1939] T b8de7c84c75e46f19b5919d240f4cef4 P dcc973a5b1454617b8a494428bcf5b0c: Deleting consensus metadata
I20260806 02:17:56.682701 5614 catalog_manager.cc:4841] TS dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499): tablet b8de7c84c75e46f19b5919d240f4cef4 (table test-table [id=61dd8ccbf0544093ad5a40395ea40b77]) successfully deleted
I20260806 02:17:56.682727 5612 catalog_manager.cc:4841] TS dc36ea51d2cb41cb914a292289ee8a2e (127.26.189.130:35503): tablet b8de7c84c75e46f19b5919d240f4cef4 (table test-table [id=61dd8ccbf0544093ad5a40395ea40b77]) successfully deleted
I20260806 02:17:56.683393 6378 ts_tablet_manager.cc:1918] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:17:56.683485 6378 log.cc:1196] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-0/wal/wals/b8de7c84c75e46f19b5919d240f4cef4
I20260806 02:17:56.683863 6378 ts_tablet_manager.cc:1939] T b8de7c84c75e46f19b5919d240f4cef4 P 6b6d37a2dcc4480f838a5c22e2a5e83c: Deleting consensus metadata
I20260806 02:17:56.684564 5612 catalog_manager.cc:4841] TS 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683): tablet b8de7c84c75e46f19b5919d240f4cef4 (table test-table [id=61dd8ccbf0544093ad5a40395ea40b77]) successfully deleted
I20260806 02:17:56.686236 5796 tablet_service.cc:1467] Processing CreateTablet for tablet 30b313c66d734aaa860a43cd867eb227 (DEFAULT_TABLE table=test-table [id=799765154eeb4f4e9dc43fa552dfafb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:56.686290 6020 tablet_service.cc:1467] Processing CreateTablet for tablet 30b313c66d734aaa860a43cd867eb227 (DEFAULT_TABLE table=test-table [id=799765154eeb4f4e9dc43fa552dfafb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:56.686532 5796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30b313c66d734aaa860a43cd867eb227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:56.686491 6211 tablet_service.cc:1467] Processing CreateTablet for tablet 30b313c66d734aaa860a43cd867eb227 (DEFAULT_TABLE table=test-table [id=799765154eeb4f4e9dc43fa552dfafb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:17:56.686589 6020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30b313c66d734aaa860a43cd867eb227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:56.686735 6211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30b313c66d734aaa860a43cd867eb227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:17:56.688568 6346 tablet_bootstrap.cc:492] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e: Bootstrap starting.
I20260806 02:17:56.688984 6345 tablet_bootstrap.cc:492] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c: Bootstrap starting.
I20260806 02:17:56.689435 6346 tablet_bootstrap.cc:654] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:56.689998 6345 tablet_bootstrap.cc:654] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:56.690659 6346 tablet_bootstrap.cc:492] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e: No bootstrap required, opened a new log
I20260806 02:17:56.690758 6348 tablet_bootstrap.cc:492] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c: Bootstrap starting.
I20260806 02:17:56.690773 6346 ts_tablet_manager.cc:1397] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 02:17:56.691218 6346 raft_consensus.cc:348] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.691349 6346 raft_consensus.cc:374] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:56.691390 6346 raft_consensus.cc:729] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc36ea51d2cb41cb914a292289ee8a2e, State: Initialized, Role: FOLLOWER
I20260806 02:17:56.691525 6346 consensus_queue.cc:260] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.691699 6348 tablet_bootstrap.cc:654] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c: Neither blocks nor log segments found. Creating new log.
I20260806 02:17:56.691823 6346 ts_tablet_manager.cc:1428] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 02:17:56.692838 6345 tablet_bootstrap.cc:492] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c: No bootstrap required, opened a new log
I20260806 02:17:56.692941 6345 ts_tablet_manager.cc:1397] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 02:17:56.692971 6348 tablet_bootstrap.cc:492] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c: No bootstrap required, opened a new log
I20260806 02:17:56.693058 6348 ts_tablet_manager.cc:1397] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260806 02:17:56.693423 6345 raft_consensus.cc:348] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.693463 6348 raft_consensus.cc:348] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.693600 6348 raft_consensus.cc:374] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:56.693595 6345 raft_consensus.cc:374] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:17:56.693639 6345 raft_consensus.cc:729] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b6d37a2dcc4480f838a5c22e2a5e83c, State: Initialized, Role: FOLLOWER
I20260806 02:17:56.693639 6348 raft_consensus.cc:729] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc973a5b1454617b8a494428bcf5b0c, State: Initialized, Role: FOLLOWER
I20260806 02:17:56.693785 6348 consensus_queue.cc:260] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.693837 6345 consensus_queue.cc:260] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.694092 6348 ts_tablet_manager.cc:1428] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:17:56.694145 6345 ts_tablet_manager.cc:1428] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 02:17:56.782842 6353 raft_consensus.cc:482] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:17:56.783031 6353 raft_consensus.cc:504] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.784309 6353 leader_election.cc:288] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc36ea51d2cb41cb914a292289ee8a2e (127.26.189.130:35503), dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499)
I20260806 02:17:56.789227 6460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.784640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:35503 (local address 127.26.189.129:44883)
0806 02:17:56.785079 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.785097 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:56.785240 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:56.785589 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:56.785605 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:56.785641 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:56.785919 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.785929 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.787028 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.787031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.787847 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.787857 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.788765 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.788768 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.788867 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.788900 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 02:17:56.788972 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 02:17:56.789036 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":77,"spinlock_wait_cycles":11904,"thread_start_us":95,"threads_started":1}
I20260806 02:17:56.789242 6338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.784767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:44883 (local address 127.26.189.130:35503)
0806 02:17:56.784913 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.784918 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.785196 (+ 278us) server_negotiation.cc:407] Connection header received
0806 02:17:56.785368 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.785371 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.785424 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.785519 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:56.786056 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.786859 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.787989 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.788617 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.788752 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.788808 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.789012 (+ 204us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.789085 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 02:17:56.789702 6044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b313c66d734aaa860a43cd867eb227" candidate_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" is_pre_election: true
I20260806 02:17:56.789896 6044 raft_consensus.cc:2454] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b6d37a2dcc4480f838a5c22e2a5e83c in term 0.
I20260806 02:17:56.790426 5754 leader_election.cc:302] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6d37a2dcc4480f838a5c22e2a5e83c, dc36ea51d2cb41cb914a292289ee8a2e; no voters:
I20260806 02:17:56.790576 6462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.784640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:35499 (local address 127.26.189.129:39171)
0806 02:17:56.785159 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.785184 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:56.785268 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:56.785589 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:56.785592 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:56.785644 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:17:56.785939 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.785945 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.788012 (+ 2067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.788015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.789100 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.789111 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.790201 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.790203 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.790289 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.790307 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 02:17:56.790372 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 02:17:56.790422 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":121,"spinlock_wait_cycles":34304,"thread_start_us":83,"threads_started":1}
I20260806 02:17:56.790660 6342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.784836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:39171 (local address 127.26.189.131:35499)
0806 02:17:56.785028 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.785032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.785271 (+ 239us) server_negotiation.cc:407] Connection header received
0806 02:17:56.785367 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.785371 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.785424 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.785519 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:17:56.786056 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.786848 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.789266 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.790055 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.790197 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.790264 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.790419 (+ 155us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.790517 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260806 02:17:56.790727 6353 raft_consensus.cc:2781] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:17:56.790786 6353 raft_consensus.cc:482] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:17:56.790835 6353 raft_consensus.cc:3037] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.791136 6239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b313c66d734aaa860a43cd867eb227" candidate_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc973a5b1454617b8a494428bcf5b0c" is_pre_election: true
I20260806 02:17:56.791283 6239 raft_consensus.cc:2454] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b6d37a2dcc4480f838a5c22e2a5e83c in term 0.
I20260806 02:17:56.792157 6353 raft_consensus.cc:504] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.792495 6353 leader_election.cc:288] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [CANDIDATE]: Term 1 election: Requested vote from peers dc36ea51d2cb41cb914a292289ee8a2e (127.26.189.130:35503), dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499)
I20260806 02:17:56.792856 6239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b313c66d734aaa860a43cd867eb227" candidate_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcc973a5b1454617b8a494428bcf5b0c"
I20260806 02:17:56.792869 6044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b313c66d734aaa860a43cd867eb227" candidate_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc36ea51d2cb41cb914a292289ee8a2e"
I20260806 02:17:56.792955 6239 raft_consensus.cc:3037] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.793013 6044 raft_consensus.cc:3037] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:17:56.794108 6239 raft_consensus.cc:2454] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b6d37a2dcc4480f838a5c22e2a5e83c in term 1.
I20260806 02:17:56.794351 6044 raft_consensus.cc:2454] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b6d37a2dcc4480f838a5c22e2a5e83c in term 1.
I20260806 02:17:56.794411 5756 leader_election.cc:302] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6d37a2dcc4480f838a5c22e2a5e83c, dcc973a5b1454617b8a494428bcf5b0c; no voters:
I20260806 02:17:56.794622 6353 raft_consensus.cc:2781] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:17:56.794821 6353 raft_consensus.cc:686] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 LEADER]: Becoming Leader. State: Replica: 6b6d37a2dcc4480f838a5c22e2a5e83c, State: Running, Role: LEADER
I20260806 02:17:56.795078 6353 consensus_queue.cc:237] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } }
I20260806 02:17:56.797454 5634 catalog_manager.cc:5495] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129). New cstate: current_term: 1 leader_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6d37a2dcc4480f838a5c22e2a5e83c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 41683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260806 02:17:56.829404 6466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.821487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40692 (local address 127.26.189.129:41683)
0806 02:17:56.825724 (+ 4237us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.825727 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.825740 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:17:56.825812 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.825814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.825866 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.826011 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:56.826299 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.826871 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.827762 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.828069 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.828168 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.828515 (+ 347us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.828930 (+ 415us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.829017 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.829136 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.829187 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4159,"thread_start_us":93,"threads_started":1}
I20260806 02:17:56.840354 6338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.836589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:43337 (local address 127.26.189.130:35503)
0806 02:17:56.836750 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.836754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.836770 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:17:56.836931 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.836934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.836980 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.837063 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:56.837345 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.838032 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.839150 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.839494 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.839597 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.839898 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.839968 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.840025 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.840131 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.840176 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 02:17:56.840405 6471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.836351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:35503 (local address 127.26.189.129:43337)
0806 02:17:56.836672 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.836690 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:56.836801 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:56.837085 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:56.837088 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:56.837097 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 02:17:56.837234 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.837240 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.838144 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.838149 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.839010 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.839021 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.839601 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.839605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.839720 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.839773 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.840049 (+ 276us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.840055 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 02:17:56.840124 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 02:17:56.840230 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":108,"threads_started":1}
I20260806 02:17:56.846638 6239 raft_consensus.cc:1261] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Refusing update from remote peer 6b6d37a2dcc4480f838a5c22e2a5e83c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:56.846643 6044 raft_consensus.cc:1261] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Refusing update from remote peer 6b6d37a2dcc4480f838a5c22e2a5e83c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:17:56.847134 6353 consensus_queue.cc:1035] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc36ea51d2cb41cb914a292289ee8a2e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:56.847363 6464 consensus_queue.cc:1035] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc973a5b1454617b8a494428bcf5b0c" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:17:56.864727 6426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.861242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:41683 (local address 127.26.189.130:42435)
0806 02:17:56.861374 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.861391 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:17:56.861500 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:17:56.861894 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:17:56.861897 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:17:56.861908 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 02:17:56.862029 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.862036 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.862736 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.862738 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.863318 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:17:56.863325 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.863947 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.863950 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:17:56.864016 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.864045 (+ 29us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.864394 (+ 349us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.864400 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 02:17:56.864490 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 02:17:56.864576 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 02:17:56.864737 6466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.861450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:42435 (local address 127.26.189.129:41683)
0806 02:17:56.861615 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 02:17:56.861621 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:17:56.861635 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:17:56.861689 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:17:56.861694 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:17:56.861741 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:17:56.861838 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:17:56.862132 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.862635 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.863552 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:17:56.863824 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:17:56.863967 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:17:56.864177 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:17:56.864293 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:17:56.864382 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 02:17:56.864508 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 02:17:56.864562 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 02:17:56.888411 5633 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:56.888573 5633 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:17:56.890888 5633 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 015cc23312a84d74aa97a3a5a8c0efcc: Sending DeleteTablet for 3 replicas of tablet 30b313c66d734aaa860a43cd867eb227
I20260806 02:17:56.891476 5796 tablet_service.cc:1514] Processing DeleteTablet for tablet 30b313c66d734aaa860a43cd867eb227 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:56 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:42472
I20260806 02:17:56.891539 6020 tablet_service.cc:1514] Processing DeleteTablet for tablet 30b313c66d734aaa860a43cd867eb227 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:56 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:35318
I20260806 02:17:56.891539 6211 tablet_service.cc:1514] Processing DeleteTablet for tablet 30b313c66d734aaa860a43cd867eb227 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:17:56 UTC) from {username='oryx', principal='oryx/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:50712
I20260806 02:17:56.891675 6378 tablet_replica.cc:330] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c: stopping tablet replica
I20260806 02:17:56.891731 6377 tablet_replica.cc:330] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e: stopping tablet replica
I20260806 02:17:56.891732 6376 tablet_replica.cc:330] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c: stopping tablet replica
I20260806 02:17:56.891809 6378 raft_consensus.cc:2229] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:17:56.891846 6377 raft_consensus.cc:2229] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:56.891846 6376 raft_consensus.cc:2229] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:17:56.891963 6376 raft_consensus.cc:2258] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:56.891964 6377 raft_consensus.cc:2258] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:56.892150 6378 raft_consensus.cc:2258] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:17:56.892697 6376 ts_tablet_manager.cc:1905] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:56.892900 6378 ts_tablet_manager.cc:1905] T 30b313c66d734aaa860a43cd867eb227 P 6b6d37a2dcc4480f838a5c22e2a5e83c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:56.893002 6377 ts_tablet_manager.cc:1905] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:17:56.893316 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 5730
I20260806 02:17:56.895826 6377 ts_tablet_manager.cc:1918] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:56.895824 6376 ts_tablet_manager.cc:1918] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 02:17:56.895893 6377 log.cc:1196] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/30b313c66d734aaa860a43cd867eb227
I20260806 02:17:56.895921 6376 log.cc:1196] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/30b313c66d734aaa860a43cd867eb227
I20260806 02:17:56.896113 6377 ts_tablet_manager.cc:1939] T 30b313c66d734aaa860a43cd867eb227 P dc36ea51d2cb41cb914a292289ee8a2e: Deleting consensus metadata
I20260806 02:17:56.896262 6376 ts_tablet_manager.cc:1939] T 30b313c66d734aaa860a43cd867eb227 P dcc973a5b1454617b8a494428bcf5b0c: Deleting consensus metadata
I20260806 02:17:56.902889 5614 catalog_manager.cc:4841] TS dcc973a5b1454617b8a494428bcf5b0c (127.26.189.131:35499): tablet 30b313c66d734aaa860a43cd867eb227 (table test-table [id=799765154eeb4f4e9dc43fa552dfafb4]) successfully deleted
I20260806 02:17:56.903574 5612 catalog_manager.cc:4841] TS dc36ea51d2cb41cb914a292289ee8a2e (127.26.189.130:35503): tablet 30b313c66d734aaa860a43cd867eb227 (table test-table [id=799765154eeb4f4e9dc43fa552dfafb4]) successfully deleted
W20260806 02:17:56.909787 5612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:41683 (error 108)
I20260806 02:17:56.910038 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 5929
I20260806 02:17:56.913512 6478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:17:56.912262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:41683 (local address 127.0.0.1:40702)
0806 02:17:56.913283 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0806 02:17:56.913370 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:41683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":925,"thread_start_us":752,"threads_started":1}
W20260806 02:17:56.913697 5612 catalog_manager.cc:4584] TS 6b6d37a2dcc4480f838a5c22e2a5e83c (127.26.189.129:41683): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 30b313c66d734aaa860a43cd867eb227: Network error: Client connection negotiation failed: client connection to 127.26.189.129:41683: connect: Connection refused (error 111)
I20260806 02:17:56.921875 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 6130
I20260806 02:17:56.934274 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 5590
2026-08-06T02:17:56Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3461 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:57 dist-test-slave-gkw7 krb5kdc[6484](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:57 dist-test-slave-gkw7 krb5kdc[6484](info): set up 2 sockets
Aug 06 02:17:57 dist-test-slave-gkw7 krb5kdc[6484](info): commencing operation
krb5kdc: starting...
W20260806 02:17:58.147786 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:58 dist-test-slave-gkw7 krb5kdc[6484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:17:58.296923 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:46399
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:40153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:46399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:58.416129 6502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:58.416409 6502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:58.416453 6502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:58.420643 6502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:58.420715 6502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:58.420737 6502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:58.420753 6502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:58.420769 6502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:58.426272 6502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:40153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:46399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:46399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:58.427533 6502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:58.428670 6502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:58.437984 6509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:58.438143 6502 server_base.cc:1034] running on GCE node
W20260806 02:17:58.437999 6515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:58.438002 6511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:58.438958 6502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:58.440296 6502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:58.441598 6502 hybrid_clock.cc:648] HybridClock initialized: now 1785982678441577 us; error 35 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T02:17:58Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1513 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:17:58 dist-test-slave-gkw7 krb5kdc[6530](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:17:58 dist-test-slave-gkw7 krb5kdc[6530](info): set up 2 sockets
Aug 06 02:17:58 dist-test-slave-gkw7 krb5kdc[6530](info): commencing operation
krb5kdc: starting...
W20260806 02:17:59.674880 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:17:59 dist-test-slave-gkw7 krb5kdc[6530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:17:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:17:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:17:59.809127 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:37637
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:37637
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:17:59.931842 6548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:17:59.932237 6548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:17:59.932340 6548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:17:59.936767 6548 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:17:59.936882 6548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:17:59.936925 6548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:17:59.936995 6548 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:17:59.937040 6548 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:17:59.942725 6548 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:37637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:37637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:17:59.943943 6548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:17:59.945051 6548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:17:59.954480 6557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:59.954566 6555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:17:59.954569 6553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:17:59.954809 6548 server_base.cc:1034] running on GCE node
I20260806 02:17:59.955446 6548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:17:59.956552 6548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:17:59.957700 6548 hybrid_clock.cc:648] HybridClock initialized: now 1785982679957683 us; error 31 us; skew 500 ppm
Aug 06 02:17:59 dist-test-slave-gkw7 krb5kdc[6530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982679, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:17:59.960532 6548 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:17:59.961434 6548 webserver.cc:460] Webserver started at http://127.26.189.190:44701/ using document root <none> and password file <none>
I20260806 02:17:59.962044 6548 fs_manager.cc:359] Metadata directory not provided
I20260806 02:17:59.962106 6548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:17:59.962282 6548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:17:59.964285 6548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "d53fc3670b5c4b0db11b352b34e18dff"
format_stamp: "Formatted at 2026-08-06 02:17:59 on dist-test-slave-gkw7"
server_key: "965df005f0a05653c1a1234e03f006cc"
server_key_iv: "32a8fbe8321bc6c8de98915a30afd547"
server_key_version: "encryptionkey@0"
I20260806 02:17:59.964790 6548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "d53fc3670b5c4b0db11b352b34e18dff"
format_stamp: "Formatted at 2026-08-06 02:17:59 on dist-test-slave-gkw7"
server_key: "965df005f0a05653c1a1234e03f006cc"
server_key_iv: "32a8fbe8321bc6c8de98915a30afd547"
server_key_version: "encryptionkey@0"
I20260806 02:17:59.968787 6548 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 02:17:59.971189 6570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:17:59.972458 6548 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 02:17:59.972597 6548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "d53fc3670b5c4b0db11b352b34e18dff"
format_stamp: "Formatted at 2026-08-06 02:17:59 on dist-test-slave-gkw7"
server_key: "965df005f0a05653c1a1234e03f006cc"
server_key_iv: "32a8fbe8321bc6c8de98915a30afd547"
server_key_version: "encryptionkey@0"
I20260806 02:17:59.972703 6548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:17:59.996348 6548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:17:59.999527 6548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:17:59.999753 6548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:00.008370 6548 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:37637
I20260806 02:18:00.008404 6644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:37637 every 8 connection(s)
I20260806 02:18:00.009415 6548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:18:00.012492 6645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:18:00.016986 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 6548
I20260806 02:18:00.017102 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:18:00.017416 27382 external_mini_cluster.cc:1428] Setting key bc77da2fda8a7c79eb8b096429da2ce6
I20260806 02:18:00.018882 6645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff: Bootstrap starting.
I20260806 02:18:00.021292 6645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff: Neither blocks nor log segments found. Creating new log.
I20260806 02:18:00.022210 6645 log.cc:824] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff: Log is configured to *not* fsync() on all Append() calls
I20260806 02:18:00.024371 6645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff: No bootstrap required, opened a new log
Aug 06 02:18:00 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:18:00.028756 6645 raft_consensus.cc:348] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fc3670b5c4b0db11b352b34e18dff" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37637 } }
I20260806 02:18:00.029026 6645 raft_consensus.cc:374] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:18:00.029132 6645 raft_consensus.cc:729] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d53fc3670b5c4b0db11b352b34e18dff, State: Initialized, Role: FOLLOWER
I20260806 02:18:00.029662 6645 consensus_queue.cc:260] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fc3670b5c4b0db11b352b34e18dff" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37637 } }
I20260806 02:18:00.029829 6645 raft_consensus.cc:388] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:18:00.029899 6645 raft_consensus.cc:482] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:18:00.030002 6645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:18:00.030982 6645 raft_consensus.cc:504] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fc3670b5c4b0db11b352b34e18dff" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37637 } }
I20260806 02:18:00.031360 6645 leader_election.cc:302] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d53fc3670b5c4b0db11b352b34e18dff; no voters:
I20260806 02:18:00.031738 6645 leader_election.cc:288] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:18:00.031868 6654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:18:00.032100 6654 raft_consensus.cc:686] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 1 LEADER]: Becoming Leader. State: Replica: d53fc3670b5c4b0db11b352b34e18dff, State: Running, Role: LEADER
I20260806 02:18:00.032430 6654 consensus_queue.cc:237] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fc3670b5c4b0db11b352b34e18dff" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37637 } }
I20260806 02:18:00.033150 6645 sys_catalog.cc:564] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:18:00.033354 6650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:00.018994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42134 (local address 127.26.189.190:37637)
0806 02:18:00.019493 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:00.019510 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:00.019547 (+ 37us) server_negotiation.cc:407] Connection header received
0806 02:18:00.020176 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:00.020193 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:00.020534 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:00.020876 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:00.021791 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.023059 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.023979 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.024464 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.024641 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:00.027542 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:00.027547 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:00.027561 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:18:00.027588 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:00.029753 (+ 2165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:00.030291 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:00.030297 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:00.030303 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:00.030428 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:00.030729 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:00.030733 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:00.030735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:00.031194 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:00.031430 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:00.031702 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 02:18:00.032263 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":154,"threads_started":1}
I20260806 02:18:00.034370 6656 sys_catalog.cc:455] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [sys.catalog]: SysCatalogTable state changed. Reason: New leader d53fc3670b5c4b0db11b352b34e18dff. Latest consensus state: current_term: 1 leader_uuid: "d53fc3670b5c4b0db11b352b34e18dff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fc3670b5c4b0db11b352b34e18dff" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37637 } } }
I20260806 02:18:00.034379 6655 sys_catalog.cc:455] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d53fc3670b5c4b0db11b352b34e18dff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fc3670b5c4b0db11b352b34e18dff" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37637 } } }
I20260806 02:18:00.034523 6656 sys_catalog.cc:458] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [sys.catalog]: This master's current role is: LEADER
I20260806 02:18:00.034523 6655 sys_catalog.cc:458] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [sys.catalog]: This master's current role is: LEADER
I20260806 02:18:00.035857 6658 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:18:00.038867 6658 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:18:00.044934 6658 catalog_manager.cc:1347] Generated new cluster ID: bac7b25d46b64d8797dcfd8126e81c06
I20260806 02:18:00.045015 6658 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:18:00.066545 6658 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:18:00.067612 6658 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:18:00.076318 6658 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff: Generated new TSK 0
I20260806 02:18:00.077035 6658 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:18:00.117416 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37637
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:18:00.237366 6681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:00.237671 6681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:00.237754 6681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:00.241884 6681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:00.241951 6681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:00.242056 6681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:18:00.247594 6681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:00.248734 6681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:00.249876 6681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:00.260613 6691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:00.260624 6688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:00.260640 6687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:00.260795 6681 server_base.cc:1034] running on GCE node
I20260806 02:18:00.261440 6681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:00.262171 6681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:00.263381 6681 hybrid_clock.cc:648] HybridClock initialized: now 1785982680263367 us; error 28 us; skew 500 ppm
Aug 06 02:18:00 dist-test-slave-gkw7 krb5kdc[6530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982680, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:18:00.266396 6681 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:18:00.267287 6681 webserver.cc:460] Webserver started at http://127.26.189.129:40133/ using document root <none> and password file <none>
I20260806 02:18:00.267834 6681 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:00.267896 6681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:00.268072 6681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:00.270325 6681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "567df92adb774ddb96c38df8a3f4ff9f"
format_stamp: "Formatted at 2026-08-06 02:18:00 on dist-test-slave-gkw7"
server_key: "77e36e25f428d322eb5e5d0b503f1bf4"
server_key_iv: "ed6c1e6d28fa8c483d65c7dc0deab786"
server_key_version: "encryptionkey@0"
I20260806 02:18:00.270856 6681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "567df92adb774ddb96c38df8a3f4ff9f"
format_stamp: "Formatted at 2026-08-06 02:18:00 on dist-test-slave-gkw7"
server_key: "77e36e25f428d322eb5e5d0b503f1bf4"
server_key_iv: "ed6c1e6d28fa8c483d65c7dc0deab786"
server_key_version: "encryptionkey@0"
I20260806 02:18:00.274865 6681 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:18:00.277642 6701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:00.279062 6681 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 02:18:00.279188 6681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "567df92adb774ddb96c38df8a3f4ff9f"
format_stamp: "Formatted at 2026-08-06 02:18:00 on dist-test-slave-gkw7"
server_key: "77e36e25f428d322eb5e5d0b503f1bf4"
server_key_iv: "ed6c1e6d28fa8c483d65c7dc0deab786"
server_key_version: "encryptionkey@0"
I20260806 02:18:00.279299 6681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:00.297209 6681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:00.300513 6681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:00.300680 6681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:00.301270 6681 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:00.302244 6681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:00.302294 6681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:00.302343 6681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:00.302359 6681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:00.311705 6681 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:38077
I20260806 02:18:00.311735 6862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:38077 every 8 connection(s)
I20260806 02:18:00.312635 6681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:18:00.315691 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 6681
I20260806 02:18:00.315826 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:18:00.316175 27382 external_mini_cluster.cc:1428] Setting key 5dc9440fde02f908c17477217a1531de
Aug 06 02:18:00 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982680, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
I20260806 02:18:00.328620 6650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:00.314588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:35967 (local address 127.26.189.190:37637)
0806 02:18:00.314747 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:00.314751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:00.315764 (+ 1013us) server_negotiation.cc:407] Connection header received
0806 02:18:00.317390 (+ 1626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:00.317393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:00.317439 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:00.317582 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:00.319274 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.319829 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.321137 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.321578 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.321708 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:00.324423 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:00.324430 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:00.324436 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:18:00.324475 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:00.326404 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:00.326950 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:00.326955 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:00.326959 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:00.327061 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:00.327412 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:00.327416 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:00.327418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:00.327697 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:00.327813 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:00.328320 (+ 507us) server_negotiation.cc:299] Negotiation successful
0806 02:18:00.328436 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 02:18:00.329514 6865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:00.314965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:35967)
0806 02:18:00.315545 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:00.315611 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:00.317149 (+ 1538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:00.317785 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:00.317792 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:00.318356 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:00.319086 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:00.319109 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.320012 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.320018 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:00.320996 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:00.321006 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.321752 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.321756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:00.321924 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:00.322602 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:00.322619 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:00.324230 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:18:00.326530 (+ 2300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:18:00.326535 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:18:00.326549 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:18:00.326827 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:18:00.327163 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:18:00.327165 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:18:00.327167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:18:00.327310 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:18:00.327815 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:18:00.327821 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:18:00.328068 (+ 247us) client_negotiation.cc:769] Sending connection context
0806 02:18:00.328259 (+ 191us) client_negotiation.cc:240] Negotiation successful
0806 02:18:00.328629 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":120,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:18:00.331177 6863 heartbeater.cc:347] Connected to a master server at 127.26.189.190:37637
I20260806 02:18:00.331447 6863 heartbeater.cc:464] Registering TS with master...
I20260806 02:18:00.331972 6863 heartbeater.cc:511] Master 127.26.189.190:37637 requested a full tablet report, sending...
I20260806 02:18:00.333946 6594 ts_manager.cc:194] Registered new tserver with Master: 567df92adb774ddb96c38df8a3f4ff9f (127.26.189.129:38077)
I20260806 02:18:00.335562 6594 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:35967
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:18:00.349934 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37637
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:18:00.469223 6868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:00.469527 6868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:00.469642 6868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:00.473867 6868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:00.473954 6868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:00.474040 6868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:18:00.479657 6868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:00.480772 6868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:00.481999 6868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:00.492379 6878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:00.492377 6877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:00.492367 6880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:00.492796 6868 server_base.cc:1034] running on GCE node
I20260806 02:18:00.493280 6868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:00.494004 6868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:00.495216 6868 hybrid_clock.cc:648] HybridClock initialized: now 1785982680495194 us; error 32 us; skew 500 ppm
Aug 06 02:18:00 dist-test-slave-gkw7 krb5kdc[6530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982680, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:18:00.498361 6868 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:18:00.499291 6868 webserver.cc:460] Webserver started at http://127.26.189.130:33433/ using document root <none> and password file <none>
I20260806 02:18:00.499913 6868 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:00.499981 6868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:00.500240 6868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:00.502602 6868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "3634f9681715437d84c8b8f880319406"
format_stamp: "Formatted at 2026-08-06 02:18:00 on dist-test-slave-gkw7"
server_key: "51bca1ee6d26d72669b2ebde47c21200"
server_key_iv: "36ce14b8fee497aaa3c48598a759bf81"
server_key_version: "encryptionkey@0"
I20260806 02:18:00.503258 6868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "3634f9681715437d84c8b8f880319406"
format_stamp: "Formatted at 2026-08-06 02:18:00 on dist-test-slave-gkw7"
server_key: "51bca1ee6d26d72669b2ebde47c21200"
server_key_iv: "36ce14b8fee497aaa3c48598a759bf81"
server_key_version: "encryptionkey@0"
I20260806 02:18:00.507752 6868 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:18:00.510569 6891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:00.511916 6868 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 02:18:00.512059 6868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "3634f9681715437d84c8b8f880319406"
format_stamp: "Formatted at 2026-08-06 02:18:00 on dist-test-slave-gkw7"
server_key: "51bca1ee6d26d72669b2ebde47c21200"
server_key_iv: "36ce14b8fee497aaa3c48598a759bf81"
server_key_version: "encryptionkey@0"
I20260806 02:18:00.512178 6868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:00.551795 6868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:00.555753 6868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:00.555997 6868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:00.556691 6868 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:00.557698 6868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:00.557752 6868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:00.557826 6868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:00.557873 6868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:00.568357 6868 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:37857
I20260806 02:18:00.568431 7034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:37857 every 8 connection(s)
I20260806 02:18:00.569782 6868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:18:00.578655 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 6868
I20260806 02:18:00.578795 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:18:00.579121 27382 external_mini_cluster.cc:1428] Setting key 7b968bc4470cfd0c4398c1f46de8382a
Aug 06 02:18:00 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982680, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:18:00.585609 6650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:00.571853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:38213 (local address 127.26.189.190:37637)
0806 02:18:00.572057 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:00.572061 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:00.572933 (+ 872us) server_negotiation.cc:407] Connection header received
0806 02:18:00.574437 (+ 1504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:00.574440 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:00.574502 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:00.574621 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:00.575964 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.576699 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.578074 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.578325 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.578447 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:00.581447 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:00.581451 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:00.581454 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:18:00.581490 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:00.583092 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:00.583764 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:00.583772 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:00.583778 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:00.583881 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:00.584278 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:00.584284 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:00.584286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:00.584496 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:00.584632 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:00.585238 (+ 606us) server_negotiation.cc:299] Negotiation successful
0806 02:18:00.585377 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260806 02:18:00.586555 7037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:00.572284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:38213)
0806 02:18:00.572757 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:00.572811 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:00.574205 (+ 1394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:00.574818 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:00.574825 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:00.575196 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:00.575807 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:00.575824 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.576838 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.576841 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:00.577942 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:00.577952 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.578493 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.578497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:00.578684 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:00.579395 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:00.579413 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:00.581235 (+ 1822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:18:00.583233 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:18:00.583239 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:18:00.583257 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:18:00.583546 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:18:00.583992 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:18:00.583997 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:18:00.583999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:18:00.584165 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:18:00.584632 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:18:00.584641 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:18:00.584914 (+ 273us) client_negotiation.cc:769] Sending connection context
0806 02:18:00.585176 (+ 262us) client_negotiation.cc:240] Negotiation successful
0806 02:18:00.585545 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":121,"threads_started":1}
I20260806 02:18:00.587968 7035 heartbeater.cc:347] Connected to a master server at 127.26.189.190:37637
I20260806 02:18:00.588286 7035 heartbeater.cc:464] Registering TS with master...
I20260806 02:18:00.588836 7035 heartbeater.cc:511] Master 127.26.189.190:37637 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
I20260806 02:18:00.590119 6594 ts_manager.cc:194] Registered new tserver with Master: 3634f9681715437d84c8b8f880319406 (127.26.189.130:37857)
I20260806 02:18:00.590843 6594 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:38213
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:18:00.609731 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37637
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:18:00.734599 7041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:00.734880 7041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:00.734926 7041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:00.739202 7041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:00.739264 7041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:00.739323 7041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:18:00.744817 7041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:00.745900 7041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:00.747103 7041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:00.757567 7048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:00.757647 7041 server_base.cc:1034] running on GCE node
W20260806 02:18:00.757567 7053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:00.757587 7049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:00.758392 7041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:00.759084 7041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:00.760329 7041 hybrid_clock.cc:648] HybridClock initialized: now 1785982680760298 us; error 39 us; skew 500 ppm
Aug 06 02:18:00 dist-test-slave-gkw7 krb5kdc[6530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982680, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:18:00.763553 7041 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:18:00.764468 7041 webserver.cc:460] Webserver started at http://127.26.189.131:38481/ using document root <none> and password file <none>
I20260806 02:18:00.765054 7041 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:00.765129 7041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:00.765318 7041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:00.767686 7041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "5e44bd6f13fd425b9aac9ef1f519a91c"
format_stamp: "Formatted at 2026-08-06 02:18:00 on dist-test-slave-gkw7"
server_key: "9700b45c297dd440a1e08af5e5c521e3"
server_key_iv: "ed922b2d437c8f322b71bfa45874e869"
server_key_version: "encryptionkey@0"
I20260806 02:18:00.768272 7041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "5e44bd6f13fd425b9aac9ef1f519a91c"
format_stamp: "Formatted at 2026-08-06 02:18:00 on dist-test-slave-gkw7"
server_key: "9700b45c297dd440a1e08af5e5c521e3"
server_key_iv: "ed922b2d437c8f322b71bfa45874e869"
server_key_version: "encryptionkey@0"
I20260806 02:18:00.772517 7041 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:18:00.775599 7062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:00.777192 7041 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:18:00.777303 7041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "5e44bd6f13fd425b9aac9ef1f519a91c"
format_stamp: "Formatted at 2026-08-06 02:18:00 on dist-test-slave-gkw7"
server_key: "9700b45c297dd440a1e08af5e5c521e3"
server_key_iv: "ed922b2d437c8f322b71bfa45874e869"
server_key_version: "encryptionkey@0"
I20260806 02:18:00.777442 7041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:00.807080 7041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:00.810573 7041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:00.810798 7041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:00.811465 7041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:00.812348 7041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:00.812397 7041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:00.812471 7041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:00.812510 7041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:00.822196 7041 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:46193
I20260806 02:18:00.822216 7221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:46193 every 8 connection(s)
I20260806 02:18:00.823135 7041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:18:00.828126 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 7041
I20260806 02:18:00.828299 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:18:00.828616 27382 external_mini_cluster.cc:1428] Setting key bd2a9e760357fe6a8bcaa0dfcfef0bc9
Aug 06 02:18:00 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982680, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:18:00.838685 6650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:00.824997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:40323 (local address 127.26.189.190:37637)
0806 02:18:00.825164 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:00.825169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:00.826073 (+ 904us) server_negotiation.cc:407] Connection header received
0806 02:18:00.827485 (+ 1412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:00.827489 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:00.827548 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:00.827632 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:00.829221 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.830035 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.831397 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.831637 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.831752 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:00.834621 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:00.834624 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:00.834627 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:18:00.834655 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:00.836443 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:00.837039 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:00.837042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:00.837044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:00.837134 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:00.837582 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:00.837585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:00.837586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:00.837796 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:00.837886 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:00.838433 (+ 547us) server_negotiation.cc:299] Negotiation successful
0806 02:18:00.838547 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:18:00.839514 7227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:00.825377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:40323)
0806 02:18:00.825909 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:00.825954 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:00.827265 (+ 1311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:00.827864 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:00.827874 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:00.828399 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:00.829065 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:00.829082 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.830186 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.830188 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:00.831277 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:00.831286 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:00.831790 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:00.831794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:00.831964 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:00.832609 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:00.832625 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:00.834441 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:18:00.836576 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:18:00.836582 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:18:00.836597 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:18:00.836941 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:18:00.837280 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:18:00.837283 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:18:00.837284 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:18:00.837433 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:18:00.837900 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:18:00.837906 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:18:00.838183 (+ 277us) client_negotiation.cc:769] Sending connection context
0806 02:18:00.838354 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 02:18:00.838624 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":185,"threads_started":1}
I20260806 02:18:00.840814 7224 heartbeater.cc:347] Connected to a master server at 127.26.189.190:37637
I20260806 02:18:00.841094 7224 heartbeater.cc:464] Registering TS with master...
I20260806 02:18:00.841779 7224 heartbeater.cc:511] Master 127.26.189.190:37637 requested a full tablet report, sending...
I20260806 02:18:00.842944 6593 ts_manager.cc:194] Registered new tserver with Master: 5e44bd6f13fd425b9aac9ef1f519a91c (127.26.189.131:46193)
I20260806 02:18:00.843533 6593 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:40323
I20260806 02:18:00.855324 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab.
Entry for principal oryx/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab.
WARNING: no policy specified for oryx/127.26.189.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab.
Entry for principal oryx/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab.
WARNING: no policy specified for oryx/127.26.189.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab.
Entry for principal oryx/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab.
I20260806 02:18:00.938726 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 6681
I20260806 02:18:00.956542 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 6868
I20260806 02:18:00.969681 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 7041
I20260806 02:18:00.979841 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 6548
I20260806 02:18:00.993213 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:37637
--webserver_interface=127.26.189.190
--webserver_port=44701
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:37637
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:18:01.111152 7236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:01.111474 7236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:01.111547 7236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:01.115670 7236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:18:01.115767 7236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:01.115806 7236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:01.115867 7236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:18:01.115908 7236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:18:01.121309 7236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:37637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:37637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=44701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:01.122565 7236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:01.123662 7236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:01.132797 7245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:01.132828 7242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:01.132858 7243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:01.133041 7236 server_base.cc:1034] running on GCE node
I20260806 02:18:01.133882 7236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:01.135180 7236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:01.136411 7236 hybrid_clock.cc:648] HybridClock initialized: now 1785982681136385 us; error 41 us; skew 500 ppm
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982681, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:18:01.139541 7236 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:18:01.140702 7236 webserver.cc:460] Webserver started at http://127.26.189.190:44701/ using document root <none> and password file <none>
I20260806 02:18:01.141330 7236 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:01.141445 7236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:01.145669 7236 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:18:01.147927 7254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:01.149361 7236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:18:01.149569 7236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "d53fc3670b5c4b0db11b352b34e18dff"
format_stamp: "Formatted at 2026-08-06 02:17:59 on dist-test-slave-gkw7"
server_key: "965df005f0a05653c1a1234e03f006cc"
server_key_iv: "32a8fbe8321bc6c8de98915a30afd547"
server_key_version: "encryptionkey@0"
I20260806 02:18:01.150262 7236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:01.164736 7236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:01.167914 7236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:01.168136 7236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:01.176226 7236 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:37637
I20260806 02:18:01.176299 7330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:37637 every 8 connection(s)
I20260806 02:18:01.177371 7236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:18:01.180639 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 7236
I20260806 02:18:01.181118 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:38077
--local_ip_for_outbound_sockets=127.26.189.129
--tserver_master_addrs=127.26.189.190:37637
--webserver_port=40133
--webserver_interface=127.26.189.129
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.189.129
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:18:01.182153 7331 sys_catalog.cc:263] Verifying existing consensus state
I20260806 02:18:01.183840 7331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff: Bootstrap starting.
I20260806 02:18:01.201464 7331 log.cc:824] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff: Log is configured to *not* fsync() on all Append() calls
I20260806 02:18:01.208381 7331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 02:18:01.208822 7331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff: Bootstrap complete.
I20260806 02:18:01.213188 7331 raft_consensus.cc:348] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fc3670b5c4b0db11b352b34e18dff" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37637 } }
I20260806 02:18:01.213647 7331 raft_consensus.cc:729] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d53fc3670b5c4b0db11b352b34e18dff, State: Initialized, Role: FOLLOWER
I20260806 02:18:01.214213 7331 consensus_queue.cc:260] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fc3670b5c4b0db11b352b34e18dff" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37637 } }
I20260806 02:18:01.214334 7331 raft_consensus.cc:388] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:18:01.214425 7331 raft_consensus.cc:482] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:18:01.214521 7331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 1 FOLLOWER]: Advancing to term 2
I20260806 02:18:01.216463 7331 raft_consensus.cc:504] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fc3670b5c4b0db11b352b34e18dff" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37637 } }
I20260806 02:18:01.216812 7331 leader_election.cc:302] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d53fc3670b5c4b0db11b352b34e18dff; no voters:
I20260806 02:18:01.217126 7331 leader_election.cc:288] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 02:18:01.217288 7338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 2 FOLLOWER]: Leader election won for term 2
I20260806 02:18:01.217571 7338 raft_consensus.cc:686] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [term 2 LEADER]: Becoming Leader. State: Replica: d53fc3670b5c4b0db11b352b34e18dff, State: Running, Role: LEADER
I20260806 02:18:01.217900 7338 consensus_queue.cc:237] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fc3670b5c4b0db11b352b34e18dff" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37637 } }
I20260806 02:18:01.218464 7331 sys_catalog.cc:564] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:18:01.219319 7339 sys_catalog.cc:455] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d53fc3670b5c4b0db11b352b34e18dff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fc3670b5c4b0db11b352b34e18dff" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37637 } } }
I20260806 02:18:01.219466 7339 sys_catalog.cc:458] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [sys.catalog]: This master's current role is: LEADER
I20260806 02:18:01.219784 7340 sys_catalog.cc:455] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [sys.catalog]: SysCatalogTable state changed. Reason: New leader d53fc3670b5c4b0db11b352b34e18dff. Latest consensus state: current_term: 2 leader_uuid: "d53fc3670b5c4b0db11b352b34e18dff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d53fc3670b5c4b0db11b352b34e18dff" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37637 } } }
I20260806 02:18:01.219872 7340 sys_catalog.cc:458] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff [sys.catalog]: This master's current role is: LEADER
I20260806 02:18:01.220160 7352 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:18:01.223538 7352 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:18:01.224196 7352 catalog_manager.cc:1259] Loaded cluster ID: bac7b25d46b64d8797dcfd8126e81c06
I20260806 02:18:01.224255 7352 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:18:01.226722 7352 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:18:01.227442 7352 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d53fc3670b5c4b0db11b352b34e18dff: Loaded TSK: 0
I20260806 02:18:01.228667 7352 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 02:18:01.320480 7336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:01.320741 7336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:01.320791 7336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:01.324970 7336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:01.325035 7336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:01.325135 7336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:18:01.330703 7336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.129.keytab
--principal=oryx/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:38077
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=40133
--tserver_master_addrs=127.26.189.190:37637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:01.331766 7336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:01.332785 7336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:01.343789 7370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:01.343808 7366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:01.343837 7367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:01.344446 7336 server_base.cc:1034] running on GCE node
I20260806 02:18:01.344930 7336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:01.345829 7336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:01.347043 7336 hybrid_clock.cc:648] HybridClock initialized: now 1785982681347011 us; error 39 us; skew 500 ppm
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982681, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:18:01.350694 7336 init.cc:377] Logged in from keytab as oryx/127.26.189.129@KRBTEST.COM (short username oryx)
I20260806 02:18:01.351866 7336 webserver.cc:460] Webserver started at http://127.26.189.129:40133/ using document root <none> and password file <none>
I20260806 02:18:01.352609 7336 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:01.352746 7336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:01.358285 7336 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:18:01.361124 7380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:01.362809 7336 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:18:01.362958 7336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "567df92adb774ddb96c38df8a3f4ff9f"
format_stamp: "Formatted at 2026-08-06 02:18:00 on dist-test-slave-gkw7"
server_key: "77e36e25f428d322eb5e5d0b503f1bf4"
server_key_iv: "ed6c1e6d28fa8c483d65c7dc0deab786"
server_key_version: "encryptionkey@0"
I20260806 02:18:01.363700 7336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:01.397444 7336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:01.401522 7336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:01.401769 7336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:01.402388 7336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:01.403251 7336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:01.403301 7336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:01.403343 7336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:01.403358 7336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:01.412760 7336 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:38077
I20260806 02:18:01.412781 7533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:38077 every 8 connection(s)
I20260806 02:18:01.413929 7336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:18:01.420485 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 7336
I20260806 02:18:01.420980 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:37857
--local_ip_for_outbound_sockets=127.26.189.130
--tserver_master_addrs=127.26.189.190:37637
--webserver_port=33433
--webserver_interface=127.26.189.130
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.189.130
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 02:18:01.429177 7536 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:01.416173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:46495 (local address 127.26.189.190:37637)
0806 02:18:01.416788 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:01.416808 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:01.417030 (+ 222us) server_negotiation.cc:407] Connection header received
0806 02:18:01.418795 (+ 1765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:01.418807 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:01.419289 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:01.419641 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:01.421100 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.422260 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.423449 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.423930 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.424125 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.428379 (+ 4254us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:46495: BlockingRecv error: recv got EOF from 127.26.189.129:46495 (error 108)
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":144,"threads_started":1}
I20260806 02:18:01.429248 7537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:01.416305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:46495)
0806 02:18:01.416842 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:01.416897 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:01.418355 (+ 1458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:01.419726 (+ 1371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:01.419734 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:01.420336 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:01.420907 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.420924 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.422409 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.422413 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.423316 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.423325 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.424108 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.424113 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.424308 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.424971 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:01.424987 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:01.428057 (+ 3070us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":141,"threads_started":1}
W20260806 02:18:01.430097 7534 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:37637 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.189.190:37637: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:01.436305 7537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:01.430753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:56525)
0806 02:18:01.430879 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:01.430895 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:01.430986 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:01.431270 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:01.431273 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:01.431453 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:01.431551 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.431557 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.432347 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.432352 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.432921 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.432930 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.433425 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.433429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.433593 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.434152 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:01.434164 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:01.436159 (+ 1995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 02:18:01.436444 7536 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:01.430877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:56525 (local address 127.26.189.190:37637)
0806 02:18:01.431027 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:01.431033 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:01.431049 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:18:01.431101 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:01.431103 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:01.431143 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:01.431253 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:01.431673 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.432228 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.433053 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.433303 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.433421 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.436318 (+ 2897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:56525: BlockingRecv error: recv got EOF from 127.26.189.129:56525 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:01.442778 7537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:01.436997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:55753)
0806 02:18:01.437161 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:01.437176 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:01.437258 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:01.437482 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:01.437484 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:01.437681 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:01.437782 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.437788 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.438487 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.438490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.439378 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.439389 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.439842 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.439847 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.439968 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.440500 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:01.440514 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:01.442635 (+ 2121us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":69}
W20260806 02:18:01.442924 7536 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:01.437128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:55753 (local address 127.26.189.190:37637)
0806 02:18:01.437273 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:01.437276 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:01.437308 (+ 32us) server_negotiation.cc:407] Connection header received
0806 02:18:01.437342 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:01.437344 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:01.437381 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:01.437438 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:01.437891 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.438385 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.439506 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.439726 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.439797 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.442775 (+ 2978us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:55753: BlockingRecv error: recv got EOF from 127.26.189.129:55753 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260806 02:18:01.443240 7534 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 02:18:01.544588 7538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:01.544874 7538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:01.544924 7538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:01.548899 7538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:01.548975 7538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:01.549038 7538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:18:01.554533 7538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.130.keytab
--principal=oryx/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:37857
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=33433
--tserver_master_addrs=127.26.189.190:37637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:01.555732 7538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:01.556774 7538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:01.567137 7551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:01.567133 7547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:01.567133 7546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:01.567512 7538 server_base.cc:1034] running on GCE node
I20260806 02:18:01.567965 7538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:01.568661 7538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:01.569857 7538 hybrid_clock.cc:648] HybridClock initialized: now 1785982681569839 us; error 33 us; skew 500 ppm
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982681, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:18:01.572813 7538 init.cc:377] Logged in from keytab as oryx/127.26.189.130@KRBTEST.COM (short username oryx)
I20260806 02:18:01.573813 7538 webserver.cc:460] Webserver started at http://127.26.189.130:33433/ using document root <none> and password file <none>
I20260806 02:18:01.574405 7538 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:01.574524 7538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:01.578702 7538 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:18:01.581007 7561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:01.582489 7538 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 02:18:01.582662 7538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "3634f9681715437d84c8b8f880319406"
format_stamp: "Formatted at 2026-08-06 02:18:00 on dist-test-slave-gkw7"
server_key: "51bca1ee6d26d72669b2ebde47c21200"
server_key_iv: "36ce14b8fee497aaa3c48598a759bf81"
server_key_version: "encryptionkey@0"
I20260806 02:18:01.583258 7538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:01.606330 7538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:01.610013 7538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:01.610231 7538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:01.610885 7538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:01.611814 7538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:01.611887 7538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:01.611972 7538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:01.612022 7538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:01.623437 7538 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:37857
I20260806 02:18:01.623457 7716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:37857 every 8 connection(s)
I20260806 02:18:01.624560 7538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:18:01.632411 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 7538
I20260806 02:18:01.632942 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:46193
--local_ip_for_outbound_sockets=127.26.189.131
--tserver_master_addrs=127.26.189.190:37637
--webserver_port=38481
--webserver_interface=127.26.189.131
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.189.131
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 02:18:01.639268 7536 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:01.626612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:42675 (local address 127.26.189.190:37637)
0806 02:18:01.626805 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:01.626814 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:01.627862 (+ 1048us) server_negotiation.cc:407] Connection header received
0806 02:18:01.630155 (+ 2293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:01.630158 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:01.630215 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:01.630297 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:01.632338 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.633210 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.635122 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.635361 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.635483 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.639135 (+ 3652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:42675: BlockingRecv error: recv got EOF from 127.26.189.130:42675 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 02:18:01.640166 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:01.626998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:42675)
0806 02:18:01.627615 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:01.627696 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:01.629839 (+ 2143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:01.630559 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:01.630571 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:01.631181 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:01.632008 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.632036 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.633385 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.633391 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.634984 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.634994 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.635545 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.635549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.635740 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.636394 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:01.636412 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:01.638997 (+ 2585us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":123,"threads_started":1}
W20260806 02:18:01.640697 7717 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:37637 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.189.190:37637: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:01.646847 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:01.641274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:34357)
0806 02:18:01.641669 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:01.641681 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:01.641787 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:01.642081 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:01.642084 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:01.642265 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:01.642361 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.642366 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.643127 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.643132 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.643706 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.643714 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.644180 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.644184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.644278 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.644793 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:01.644808 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:01.646688 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":188}
W20260806 02:18:01.646948 7536 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:01.641361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:34357 (local address 127.26.189.190:37637)
0806 02:18:01.641516 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:01.641521 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:01.641745 (+ 224us) server_negotiation.cc:407] Connection header received
0806 02:18:01.641929 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:01.641932 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:01.641975 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:01.642063 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:01.642478 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.643009 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.643830 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.644054 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.644171 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.646817 (+ 2646us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:34357: BlockingRecv error: recv got EOF from 127.26.189.130:34357 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:01.652895 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:01.647782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:48851)
0806 02:18:01.647944 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:01.647959 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:01.648045 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:01.648312 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:01.648315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:01.648476 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:01.648547 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.648551 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.649383 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.649388 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.649989 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.649997 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.650448 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.650452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.650531 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.651028 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:01.651042 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:01.652749 (+ 1707us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103}
W20260806 02:18:01.652988 7536 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:01.647833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:48851 (local address 127.26.189.190:37637)
0806 02:18:01.647941 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:01.647945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:01.648002 (+ 57us) server_negotiation.cc:407] Connection header received
0806 02:18:01.648158 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:01.648161 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:01.648212 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:01.648296 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:01.648667 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.649274 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.650108 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.650334 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.650446 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.652862 (+ 2416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:48851: BlockingRecv error: recv got EOF from 127.26.189.130:48851 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260806 02:18:01.653424 7717 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 02:18:01.779417 7721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:01.779701 7721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:01.779776 7721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:01.784072 7721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:01.784138 7721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:01.784235 7721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:18:01.789902 7721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/krb5kdc/oryx_127.26.189.131.keytab
--principal=oryx/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:46193
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=38481
--tserver_master_addrs=127.26.189.190:37637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:01.791075 7721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:01.792234 7721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:01.802520 7730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:01.802527 7732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:01.802529 7728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:01.802644 7721 server_base.cc:1034] running on GCE node
I20260806 02:18:01.803303 7721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:01.803952 7721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:01.805140 7721 hybrid_clock.cc:648] HybridClock initialized: now 1785982681805117 us; error 27 us; skew 500 ppm
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982681, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:18:01.808223 7721 init.cc:377] Logged in from keytab as oryx/127.26.189.131@KRBTEST.COM (short username oryx)
I20260806 02:18:01.809593 7721 webserver.cc:460] Webserver started at http://127.26.189.131:38481/ using document root <none> and password file <none>
I20260806 02:18:01.810204 7721 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:01.810288 7721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:01.814324 7721 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:18:01.816493 7741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:01.817912 7721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:18:01.818018 7721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "5e44bd6f13fd425b9aac9ef1f519a91c"
format_stamp: "Formatted at 2026-08-06 02:18:00 on dist-test-slave-gkw7"
server_key: "9700b45c297dd440a1e08af5e5c521e3"
server_key_iv: "ed922b2d437c8f322b71bfa45874e869"
server_key_version: "encryptionkey@0"
I20260806 02:18:01.818588 7721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:01.833691 7721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:01.837131 7721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:01.837311 7721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:01.837971 7721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:01.838798 7721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:01.838847 7721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:01.838888 7721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:01.838904 7721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:01.848061 7721 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:46193
I20260806 02:18:01.848089 7902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:46193 every 8 connection(s)
I20260806 02:18:01.849182 7721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:18:01.852928 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 7721
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 02:18:01.861110 7536 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:01.851056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:54233 (local address 127.26.189.190:37637)
0806 02:18:01.851215 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:01.851220 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:01.852138 (+ 918us) server_negotiation.cc:407] Connection header received
0806 02:18:01.853698 (+ 1560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:01.853702 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:01.853764 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:01.853882 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:01.855609 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.856121 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.857278 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.857494 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.857651 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.860986 (+ 3335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:54233: BlockingRecv error: recv got EOF from 127.26.189.131:54233 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 02:18:01.861951 7907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:01.851511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:54233)
0806 02:18:01.851978 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:01.852022 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:01.853430 (+ 1408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:01.854106 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:01.854117 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:01.854701 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:01.855453 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.855473 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.856260 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.856263 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.857145 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.857155 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.857714 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.857719 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.857892 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.858407 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:01.858423 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:01.860886 (+ 2463us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":133,"threads_started":1}
W20260806 02:18:01.862448 7905 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:37637 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.189.190:37637: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
I20260806 02:18:01.863529 7910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:01.853993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42140 (local address 127.26.189.190:37637)
0806 02:18:01.854265 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:01.854270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:01.854285 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:18:01.854429 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:01.854432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:01.854468 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:01.854544 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:01.855453 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.856002 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.856926 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.857169 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.857279 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.858971 (+ 1692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:01.858977 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:01.858991 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:18:01.859016 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:01.860786 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:01.861323 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:01.861329 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:01.861334 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:01.861455 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:01.861780 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:01.861785 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:01.861786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:01.862196 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:01.862444 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:01.863065 (+ 621us) server_negotiation.cc:299] Negotiation successful
0806 02:18:01.863344 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":202,"thread_start_us":145,"threads_started":1}
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:01.868455 7907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:01.863055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:48155)
0806 02:18:01.863251 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:01.863265 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:01.863333 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:01.863556 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:01.863558 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:01.863756 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:01.863847 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.863851 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.864757 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.864762 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.865383 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.865393 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.866002 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.866005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.866101 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.866602 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:01.866614 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:01.868365 (+ 1751us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130}
W20260806 02:18:01.868625 7536 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:01.863166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:48155 (local address 127.26.189.190:37637)
0806 02:18:01.863286 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:01.863292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:01.863309 (+ 17us) server_negotiation.cc:407] Connection header received
0806 02:18:01.863412 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:01.863415 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:01.863456 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:01.863528 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:01.863952 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.864638 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.865500 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.865882 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.865990 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.868500 (+ 2510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:48155: BlockingRecv error: recv got EOF from 127.26.189.131:48155 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:01 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:01.873654 7907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:01.869014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:35303)
0806 02:18:01.869138 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:01.869154 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:01.869238 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:01.869464 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:01.869466 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:01.869653 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:01.869738 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.869743 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.870542 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.870545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.871081 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:01.871089 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.871485 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.871487 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:01.871545 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.871918 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:01.871928 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:01.873481 (+ 1553us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 02:18:01.873894 7536 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:01.869113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:35303 (local address 127.26.189.190:37637)
0806 02:18:01.869262 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:01.869265 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:01.869277 (+ 12us) server_negotiation.cc:407] Connection header received
0806 02:18:01.869306 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:01.869308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:01.869340 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:01.869439 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:01.869846 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.870440 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.871189 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:01.871389 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:01.871466 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:01.873660 (+ 2194us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:35303: BlockingRecv error: recv got EOF from 127.26.189.131:35303 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260806 02:18:01.873935 7905 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 02:18:02 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:02 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:02.449872 7911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:02.443965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:33675)
0806 02:18:02.444249 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:02.444262 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:02.444356 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:02.444681 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:02.444684 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:02.444870 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:02.444998 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:02.445003 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:02.445910 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:02.445912 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:02.446479 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:02.446487 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:02.446964 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:02.446966 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:02.447038 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:02.447608 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:02.447630 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:02.449741 (+ 2111us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":94,"threads_started":1}
W20260806 02:18:02.450073 7912 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:02.444029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:33675 (local address 127.26.189.190:37637)
0806 02:18:02.444311 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:02.444319 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:02.444335 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:18:02.444483 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:02.444486 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:02.444539 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:02.444638 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:02.445167 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:02.445809 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:02.446599 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:02.446860 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:02.446947 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:02.449887 (+ 2940us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:33675: BlockingRecv error: recv got EOF from 127.26.189.129:33675 (error 108)
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":64,"threads_started":1}
Aug 06 02:18:02 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:02 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:02.659822 7913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:02.654107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:52453)
0806 02:18:02.654397 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:02.654430 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:02.654552 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:02.654901 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:02.654904 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:02.655096 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:02.655237 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:02.655243 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:02.656053 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:02.656056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:02.656653 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:02.656660 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:02.657105 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:02.657108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:02.657196 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:02.657865 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:02.657878 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:02.659704 (+ 1826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":103,"threads_started":1}
W20260806 02:18:02.659973 7912 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:02.654153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:52453 (local address 127.26.189.190:37637)
0806 02:18:02.654319 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:02.654323 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:02.654516 (+ 193us) server_negotiation.cc:407] Connection header received
0806 02:18:02.654677 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:02.654680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:02.654729 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:02.654809 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:02.655388 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:02.655942 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:02.656771 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:02.656998 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:02.657086 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:02.659852 (+ 2766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:52453: BlockingRecv error: recv got EOF from 127.26.189.130:52453 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 06 02:18:02 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:02 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 02:18:02.881484 7912 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:02.874685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:33339 (local address 127.26.189.190:37637)
0806 02:18:02.874863 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:02.874870 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:02.875033 (+ 163us) server_negotiation.cc:407] Connection header received
0806 02:18:02.875146 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:02.875158 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:02.875230 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:02.875331 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:02.875769 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:02.876754 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:02.877591 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:02.878096 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:02.878236 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:02.881391 (+ 3155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:33339: BlockingRecv error: recv got EOF from 127.26.189.131:33339 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 02:18:02.881502 7914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:02.874597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:33339)
0806 02:18:02.874934 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:02.874953 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:02.875064 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:02.875375 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:02.875378 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:02.875551 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:02.875647 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:02.875652 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:02.876866 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:02.876869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:02.877451 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:02.877459 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:02.878252 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:02.878257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:02.878358 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:02.878956 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:02.878974 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:02.881266 (+ 2292us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":99,"threads_started":1}
Aug 06 02:18:03 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:03 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:03.456549 7915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:03.450752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:43545)
0806 02:18:03.451081 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:03.451103 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:03.451212 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:03.451473 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:03.451476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:03.451682 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:03.451817 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:03.451823 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:03.452685 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:03.452691 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:03.453347 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:03.453359 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:03.453934 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:03.453937 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:03.454017 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:03.454552 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:03.454586 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:03.456424 (+ 1838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":87,"threads_started":1}
W20260806 02:18:03.456732 7916 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:03.450888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:43545 (local address 127.26.189.190:37637)
0806 02:18:03.451235 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:03.451238 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:03.451252 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:18:03.451289 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:03.451291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:03.451333 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:03.451418 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:03.451955 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:03.452533 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:03.453489 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:03.453801 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:03.453894 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:03.456576 (+ 2682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:43545: BlockingRecv error: recv got EOF from 127.26.189.129:43545 (error 108)
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":111,"threads_started":1}
Aug 06 02:18:03 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:03 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:03.667359 7917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:03.660805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:52601)
0806 02:18:03.661168 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:03.661188 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:03.661358 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:03.661737 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:03.661740 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:03.662016 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:03.662134 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:03.662141 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:03.663064 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:03.663072 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:03.663749 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:03.663759 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:03.664345 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:03.664350 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:03.664457 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:03.665021 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:03.665034 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:03.667226 (+ 2192us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":97,"threads_started":1}
W20260806 02:18:03.667595 7916 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:03.660924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:52601 (local address 127.26.189.190:37637)
0806 02:18:03.661162 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:03.661168 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:03.661291 (+ 123us) server_negotiation.cc:407] Connection header received
0806 02:18:03.661497 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:03.661501 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:03.661594 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:03.661708 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:03.662304 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:03.662925 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:03.663934 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:03.664204 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:03.664340 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:03.667428 (+ 3088us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:52601: BlockingRecv error: recv got EOF from 127.26.189.130:52601 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 06 02:18:03 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:03 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:03.888448 7918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:03.882649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:39975)
0806 02:18:03.882941 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:03.882958 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:03.883081 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:03.883379 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:03.883382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:03.883597 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:03.883698 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:03.883704 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:03.884485 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:03.884490 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:03.885066 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:03.885075 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:03.885583 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:03.885587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:03.885685 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:03.886296 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:03.886308 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:03.888326 (+ 2018us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":112,"threads_started":1}
W20260806 02:18:03.888682 7916 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:03.882842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:39975 (local address 127.26.189.190:37637)
0806 02:18:03.882998 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:03.883006 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:03.883024 (+ 18us) server_negotiation.cc:407] Connection header received
0806 02:18:03.883195 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:03.883199 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:03.883256 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:03.883347 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:03.883828 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:03.884366 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:03.885195 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:03.885430 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:03.885540 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:03.888536 (+ 2996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:39975: BlockingRecv error: recv got EOF from 127.26.189.131:39975 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 02:18:04 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:04 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:04.463132 7919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:04.457529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:44443)
0806 02:18:04.457872 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:04.457888 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:04.458002 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:04.458294 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:04.458296 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:04.458487 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:04.458589 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:04.458594 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:04.459368 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:04.459372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:04.459933 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:04.459941 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:04.460466 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:04.460468 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:04.460530 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:04.461050 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:04.461062 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:04.463009 (+ 1947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":112,"threads_started":1}
W20260806 02:18:04.463449 7920 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:04.457626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:44443 (local address 127.26.189.190:37637)
0806 02:18:04.457889 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:04.457893 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:04.457993 (+ 100us) server_negotiation.cc:407] Connection header received
0806 02:18:04.458094 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:04.458096 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:04.458172 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:04.458247 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:04.458698 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:04.459254 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:04.460072 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:04.460350 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:04.460447 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:04.463189 (+ 2742us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:44443: BlockingRecv error: recv got EOF from 127.26.189.129:44443 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":105,"threads_started":1}
Aug 06 02:18:04 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:04 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:04.674300 7921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:04.668159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:42019)
0806 02:18:04.668491 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:04.668516 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:04.668660 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:04.669132 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:04.669135 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:04.669377 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:04.669485 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:04.669491 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:04.670345 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:04.670349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:04.670952 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:04.670961 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:04.671395 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:04.671398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:04.671464 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:04.672047 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:04.672060 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:04.674073 (+ 2013us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":109,"threads_started":1}
W20260806 02:18:04.674396 7920 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:04.668200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:42019 (local address 127.26.189.190:37637)
0806 02:18:04.668368 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:04.668373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:04.668667 (+ 294us) server_negotiation.cc:407] Connection header received
0806 02:18:04.668936 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:04.668940 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:04.669001 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:04.669091 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:04.669637 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:04.670174 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:04.671065 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:04.671291 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:04.671370 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:04.674252 (+ 2882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:42019: BlockingRecv error: recv got EOF from 127.26.189.130:42019 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 06 02:18:04 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:04 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:04.895095 7922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:04.889274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:42855)
0806 02:18:04.889646 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:04.889676 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:04.889781 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:04.890084 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:04.890088 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:04.890342 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:04.890467 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:04.890474 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:04.891249 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:04.891254 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:04.891837 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:04.891845 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:04.892325 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:04.892329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:04.892417 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:04.892987 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:04.893000 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:04.894941 (+ 1941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":101,"threads_started":1}
W20260806 02:18:04.895268 7920 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:04.889409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:42855 (local address 127.26.189.190:37637)
0806 02:18:04.889637 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:04.889641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:04.889756 (+ 115us) server_negotiation.cc:407] Connection header received
0806 02:18:04.889876 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:04.889879 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:04.889943 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:04.890051 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:04.890588 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:04.891128 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:04.891961 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:04.892201 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:04.892310 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:04.895084 (+ 2774us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:42855: BlockingRecv error: recv got EOF from 127.26.189.131:42855 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 06 02:18:05 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:05 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:05.473337 7923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:05.463971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:33611)
0806 02:18:05.464286 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:05.464299 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:05.464405 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:05.464651 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:05.464654 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:05.464839 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:05.464937 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:05.464942 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:05.465817 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:05.465819 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:05.466382 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:05.466391 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:05.466955 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:05.466958 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:05.467028 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:05.471077 (+ 4049us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:05.471089 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:05.473219 (+ 2130us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":95,"threads_started":1}
W20260806 02:18:05.473668 7924 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:05.464031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:33611 (local address 127.26.189.190:37637)
0806 02:18:05.464297 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:05.464302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:05.464378 (+ 76us) server_negotiation.cc:407] Connection header received
0806 02:18:05.464487 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:05.464489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:05.464533 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:05.464614 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:05.465051 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:05.465719 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:05.466515 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:05.466786 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:05.466916 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:05.473449 (+ 6533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:33611: BlockingRecv error: recv got EOF from 127.26.189.129:33611 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":72,"threads_started":1}
Aug 06 02:18:05 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:05 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:05.681015 7925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:05.675244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:56849)
0806 02:18:05.675534 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:05.675548 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:05.675686 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:05.675979 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:05.675981 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:05.676182 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:05.676288 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:05.676294 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:05.677057 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:05.677059 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:05.677679 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:05.677689 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:05.678264 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:05.678268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:05.678345 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:05.678839 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:05.678851 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:05.680894 (+ 2043us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":117,"threads_started":1}
W20260806 02:18:05.681193 7924 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:05.675292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:56849 (local address 127.26.189.190:37637)
0806 02:18:05.675454 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:05.675458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:05.675622 (+ 164us) server_negotiation.cc:407] Connection header received
0806 02:18:05.675777 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:05.675779 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:05.675842 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:05.675913 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:05.676407 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:05.676960 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:05.677800 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:05.678052 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:05.678144 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:05.681049 (+ 2905us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:56849: BlockingRecv error: recv got EOF from 127.26.189.130:56849 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 06 02:18:05 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:05 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:05.902007 7926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:05.895997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:34033)
0806 02:18:05.896362 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:05.896379 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:05.896534 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:05.896831 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:05.896834 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:05.897052 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:05.897150 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:05.897157 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:05.898180 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:05.898185 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:05.898756 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:05.898765 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:05.899250 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:05.899254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:05.899344 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:05.899861 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:05.899873 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:05.901887 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":115,"threads_started":1}
W20260806 02:18:05.902331 7924 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:05.896163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:34033 (local address 127.26.189.190:37637)
0806 02:18:05.896346 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:05.896351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:05.896472 (+ 121us) server_negotiation.cc:407] Connection header received
0806 02:18:05.896643 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:05.896646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:05.896707 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:05.896801 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:05.897284 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:05.898073 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:05.898885 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:05.899124 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:05.899245 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:05.902048 (+ 2803us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:34033: BlockingRecv error: recv got EOF from 127.26.189.131:34033 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 06 02:18:06 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:06 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:06.479976 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:06.474166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:35051)
0806 02:18:06.474512 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:06.474526 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:06.474621 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:06.474927 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:06.474930 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:06.475133 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:06.475232 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:06.475238 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:06.476122 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:06.476125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:06.476707 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:06.476716 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:06.477179 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:06.477182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:06.477250 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:06.477788 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:06.477800 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:06.479855 (+ 2055us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":99,"threads_started":1}
W20260806 02:18:06.480201 7929 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:06.474307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:35051 (local address 127.26.189.190:37637)
0806 02:18:06.474565 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:06.474569 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:06.474582 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:18:06.474718 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:06.474720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:06.474766 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:06.474846 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:06.475390 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:06.475970 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:06.476821 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:06.477074 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:06.477163 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:06.480007 (+ 2844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:35051: BlockingRecv error: recv got EOF from 127.26.189.129:35051 (error 108)
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":75,"threads_started":1}
Aug 06 02:18:06 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:06 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:06.688247 7930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:06.681945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:42613)
0806 02:18:06.682310 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:06.682327 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:06.682445 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:06.682753 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:06.682756 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:06.683001 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:06.683132 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:06.683139 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:06.684197 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:06.684200 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:06.684886 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:06.684895 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:06.685366 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:06.685370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:06.685438 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:06.685971 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:06.685983 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:06.688060 (+ 2077us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":133,"threads_started":1}
W20260806 02:18:06.688329 7929 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:06.682141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:42613 (local address 127.26.189.190:37637)
0806 02:18:06.682312 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:06.682317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:06.682390 (+ 73us) server_negotiation.cc:407] Connection header received
0806 02:18:06.682596 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:06.682598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:06.682643 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:06.682730 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:06.683295 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:06.684062 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:06.684999 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:06.685240 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:06.685328 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:06.688206 (+ 2878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:42613: BlockingRecv error: recv got EOF from 127.26.189.130:42613 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 06 02:18:06 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:06 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:06.908751 7931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:06.902948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:47363)
0806 02:18:06.903275 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:06.903290 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:06.903385 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:06.903655 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:06.903658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:06.903870 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:06.903973 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:06.903978 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:06.904925 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:06.904929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:06.905665 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:06.905675 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:06.906173 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:06.906175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:06.906240 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:06.906742 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:06.906754 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:06.908633 (+ 1879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":114,"threads_started":1}
W20260806 02:18:06.908896 7929 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:06.903052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:47363 (local address 127.26.189.190:37637)
0806 02:18:06.903249 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:06.903254 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:06.903363 (+ 109us) server_negotiation.cc:407] Connection header received
0806 02:18:06.903468 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:06.903470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:06.903515 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:06.903601 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:06.904098 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:06.904792 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:06.905786 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:06.906016 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:06.906130 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:06.908772 (+ 2642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:47363: BlockingRecv error: recv got EOF from 127.26.189.131:47363 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 06 02:18:07 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:07 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:07.486778 7932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:07.480890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:38513)
0806 02:18:07.481201 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:07.481215 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:07.481313 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:07.481625 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:07.481627 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:07.481838 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:07.481943 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:07.481949 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:07.482736 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:07.482739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:07.483312 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:07.483321 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:07.483781 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:07.483784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:07.483851 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:07.484398 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:07.484416 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:07.486598 (+ 2182us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":115,"threads_started":1}
W20260806 02:18:07.486909 7933 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:07.481048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:38513 (local address 127.26.189.190:37637)
0806 02:18:07.481329 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:07.481333 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:07.481349 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:18:07.481392 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:07.481395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:07.481436 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:07.481590 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:07.482058 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:07.482616 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:07.483421 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:07.483671 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:07.483755 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:07.486755 (+ 3000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:38513: BlockingRecv error: recv got EOF from 127.26.189.129:38513 (error 108)
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":72,"threads_started":1}
Aug 06 02:18:07 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:07 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:07.694619 7936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:07.689053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:34309)
0806 02:18:07.689361 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:07.689376 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:07.689485 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:07.689757 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:07.689759 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:07.689965 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:07.690065 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:07.690071 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:07.690852 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:07.690856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:07.691507 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:07.691517 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:07.691973 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:07.691977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:07.692049 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:07.692555 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:07.692567 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:07.694501 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":82,"threads_started":1}
W20260806 02:18:07.694837 7933 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:07.689146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:34309 (local address 127.26.189.190:37637)
0806 02:18:07.689344 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:07.689348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:07.689455 (+ 107us) server_negotiation.cc:407] Connection header received
0806 02:18:07.689590 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:07.689592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:07.689639 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:07.689717 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:07.690186 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:07.690737 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:07.691619 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:07.691850 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:07.691928 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:07.694715 (+ 2787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:34309: BlockingRecv error: recv got EOF from 127.26.189.130:34309 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 06 02:18:07 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:07 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:07.915959 7937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:07.909927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:40269)
0806 02:18:07.910332 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:07.910349 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:07.910477 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:07.910836 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:07.910847 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:07.911060 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:07.911167 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:07.911172 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:07.911953 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:07.911956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:07.912533 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:07.912541 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:07.913034 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:07.913038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:07.913127 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:07.913806 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:07.913829 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:07.915835 (+ 2006us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":98,"threads_started":1}
W20260806 02:18:07.916152 7933 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:07.909986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:40269 (local address 127.26.189.190:37637)
0806 02:18:07.910156 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:07.910161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:07.910450 (+ 289us) server_negotiation.cc:407] Connection header received
0806 02:18:07.910594 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:07.910599 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:07.910669 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:07.910786 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:07.911288 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:07.911847 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:07.912655 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:07.912889 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:07.912983 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:07.915986 (+ 3003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:40269: BlockingRecv error: recv got EOF from 127.26.189.131:40269 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 02:18:08 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:08 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:08.493760 7938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:08.487786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:54665)
0806 02:18:08.488247 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:08.488298 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:08.488412 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:08.488696 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:08.488699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:08.488895 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:08.488996 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:08.489002 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:08.489783 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:08.489786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:08.490366 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:08.490375 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:08.490927 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:08.490931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:08.491028 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:08.491650 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:08.491664 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:08.493630 (+ 1966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":103,"threads_started":1}
W20260806 02:18:08.493903 7939 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:08.487935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:54665 (local address 127.26.189.190:37637)
0806 02:18:08.488223 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:08.488228 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:08.488410 (+ 182us) server_negotiation.cc:407] Connection header received
0806 02:18:08.488484 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:08.488487 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:08.488536 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:08.488625 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:08.489119 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:08.489689 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:08.490468 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:08.490777 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:08.490890 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:08.493767 (+ 2877us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:54665: BlockingRecv error: recv got EOF from 127.26.189.129:54665 (error 108)
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":70,"threads_started":1}
Aug 06 02:18:08 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:08 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:08.701234 7940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:08.695403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:38989)
0806 02:18:08.695729 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:08.695743 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:08.695843 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:08.696085 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:08.696087 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:08.696303 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:08.696403 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:08.696409 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:08.697333 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:08.697337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:08.698071 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:08.698081 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:08.698580 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:08.698584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:08.698674 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:08.699212 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:08.699224 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:08.701098 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":95,"threads_started":1}
W20260806 02:18:08.701406 7939 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:08.695479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:38989 (local address 127.26.189.190:37637)
0806 02:18:08.695651 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:08.695654 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:08.695821 (+ 167us) server_negotiation.cc:407] Connection header received
0806 02:18:08.695924 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:08.695926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:08.695972 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:08.696047 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:08.696517 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:08.697200 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:08.698203 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:08.698450 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:08.698564 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:08.701272 (+ 2708us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:38989: BlockingRecv error: recv got EOF from 127.26.189.130:38989 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 06 02:18:08 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:08 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:08.923133 7941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:08.916786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:55777)
0806 02:18:08.917132 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:08.917147 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:08.917250 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:08.917512 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:08.917515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:08.917744 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:08.917844 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:08.917850 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:08.918737 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:08.918745 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:08.919495 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:08.919505 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:08.920131 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:08.920135 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:08.920221 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:08.920848 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:08.920862 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:08.922940 (+ 2078us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":122,"threads_started":1}
W20260806 02:18:08.923342 7939 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:08.916890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:55777 (local address 127.26.189.190:37637)
0806 02:18:08.917038 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:08.917041 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:08.917219 (+ 178us) server_negotiation.cc:407] Connection header received
0806 02:18:08.917318 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:08.917320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:08.917367 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:08.917436 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:08.917988 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:08.918576 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:08.919628 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:08.919952 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:08.920112 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:08.923168 (+ 3056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:55777: BlockingRecv error: recv got EOF from 127.26.189.131:55777 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 06 02:18:09 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:09 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:09.500232 7942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:09.494722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:49479)
0806 02:18:09.495029 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:09.495042 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:09.495133 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:09.495391 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:09.495393 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:09.495575 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:09.495681 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:09.495686 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:09.496442 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:09.496445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:09.497002 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:09.497010 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:09.497451 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:09.497453 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:09.497521 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:09.498120 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:09.498133 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:09.500058 (+ 1925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":108,"threads_started":1}
W20260806 02:18:09.500353 7945 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:09.494877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:49479 (local address 127.26.189.190:37637)
0806 02:18:09.495096 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:09.495099 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:09.495112 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:18:09.495231 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:09.495233 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:09.495279 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:09.495356 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:09.495779 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:09.496342 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:09.497102 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:09.497347 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:09.497423 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:09.500219 (+ 2796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:49479: BlockingRecv error: recv got EOF from 127.26.189.129:49479 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":64,"threads_started":1}
Aug 06 02:18:09 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:09 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:09.707769 7947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:09.702106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:39467)
0806 02:18:09.702423 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:09.702438 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:09.702546 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:09.702784 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:09.702786 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:09.702978 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:09.703080 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:09.703085 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:09.704013 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:09.704017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:09.704602 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:09.704612 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:09.705056 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:09.705059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:09.705125 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:09.705738 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:09.705750 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:09.707643 (+ 1893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":108,"threads_started":1}
W20260806 02:18:09.708035 7945 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:09.702153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:39467 (local address 127.26.189.190:37637)
0806 02:18:09.702326 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:09.702332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:09.702515 (+ 183us) server_negotiation.cc:407] Connection header received
0806 02:18:09.702625 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:09.702627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:09.702673 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:09.702742 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:09.703191 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:09.703900 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:09.704735 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:09.704956 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:09.705033 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:09.707892 (+ 2859us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:39467: BlockingRecv error: recv got EOF from 127.26.189.130:39467 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 02:18:09 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:09 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:09.929415 7949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:09.924006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:46917)
0806 02:18:09.924355 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:09.924368 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:09.924473 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:09.924723 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:09.924725 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:09.924911 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:09.925009 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:09.925013 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:09.925849 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:09.925853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:09.926418 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:09.926427 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:09.926853 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:09.926856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:09.926918 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:09.927441 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:09.927453 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:09.929299 (+ 1846us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":98,"threads_started":1}
W20260806 02:18:09.929628 7945 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:09.924125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:46917 (local address 127.26.189.190:37637)
0806 02:18:09.924302 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:09.924305 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:09.924450 (+ 145us) server_negotiation.cc:407] Connection header received
0806 02:18:09.924560 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:09.924562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:09.924611 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:09.924687 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:09.925112 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:09.925744 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:09.926529 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:09.926753 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:09.926832 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:09.929441 (+ 2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:46917: BlockingRecv error: recv got EOF from 127.26.189.131:46917 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 06 02:18:10 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:10 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:10.512006 7950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:10.501244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:43737)
0806 02:18:10.501637 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:10.501652 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:10.501756 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:10.502018 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:10.502020 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:10.502218 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:10.502327 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:10.502333 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:10.503277 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:10.503283 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:10.503964 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:10.503975 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:10.504483 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:10.504487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:10.504573 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:10.509695 (+ 5122us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:10.509708 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:10.511816 (+ 2108us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":78,"threads_started":1}
W20260806 02:18:10.512120 7952 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:10.501350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:43737 (local address 127.26.189.190:37637)
0806 02:18:10.501695 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:10.501699 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:10.501714 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:18:10.501849 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:10.501851 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:10.501896 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:10.501975 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:10.502463 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:10.503155 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:10.504128 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:10.504361 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:10.504479 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:10.511970 (+ 7491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:43737: BlockingRecv error: recv got EOF from 127.26.189.129:43737 (error 108)
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":90,"threads_started":1}
Aug 06 02:18:10 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:10 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:10.714560 7953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:10.708640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:56615)
0806 02:18:10.708994 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:10.709012 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:10.709169 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:10.709479 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:10.709482 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:10.709746 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:10.709848 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:10.709854 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:10.710642 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:10.710654 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:10.711224 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:10.711232 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:10.711716 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:10.711720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:10.711812 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:10.712360 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:10.712372 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:10.714440 (+ 2068us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":133,"threads_started":1}
W20260806 02:18:10.714793 7952 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:10.708809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:56615 (local address 127.26.189.190:37637)
0806 02:18:10.708992 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:10.708997 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:10.709107 (+ 110us) server_negotiation.cc:407] Connection header received
0806 02:18:10.709299 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:10.709303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:10.709359 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:10.709450 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:10.709975 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:10.710523 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:10.711351 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:10.711592 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:10.711709 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:10.714650 (+ 2941us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:56615: BlockingRecv error: recv got EOF from 127.26.189.130:56615 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 06 02:18:10 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:10 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:10.935746 7954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:10.930191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:48549)
0806 02:18:10.930508 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:10.930522 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:10.930622 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:10.930859 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:10.930861 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:10.931050 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:10.931148 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:10.931153 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:10.931876 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:10.931878 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:10.932444 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:10.932452 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:10.932978 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:10.932981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:10.933051 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:10.933709 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:10.933721 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:10.935621 (+ 1900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":127,"threads_started":1}
W20260806 02:18:10.936091 7952 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:10.930287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:48549 (local address 127.26.189.190:37637)
0806 02:18:10.930438 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:10.930443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:10.930589 (+ 146us) server_negotiation.cc:407] Connection header received
0806 02:18:10.930702 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:10.930704 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:10.930750 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:10.930819 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:10.931250 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:10.931782 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:10.932561 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:10.932845 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:10.932930 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:10.935791 (+ 2861us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:48549: BlockingRecv error: recv got EOF from 127.26.189.131:48549 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 02:18:11 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:11 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:11.519061 7956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:11.513026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:38949)
0806 02:18:11.513329 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:11.513343 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:11.513434 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:11.513761 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:11.513763 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:11.513949 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:11.514048 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:11.514053 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:11.514863 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:11.514866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:11.515446 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:11.515455 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:11.515915 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:11.515918 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:11.515983 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:11.516495 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:11.516506 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:11.518945 (+ 2439us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":104,"threads_started":1}
W20260806 02:18:11.519302 7957 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:11.513088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:38949 (local address 127.26.189.190:37637)
0806 02:18:11.513508 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:11.513512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:11.513547 (+ 35us) server_negotiation.cc:407] Connection header received
0806 02:18:11.513588 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:11.513590 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:11.513636 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:11.513722 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:11.514178 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:11.514748 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:11.515564 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:11.515810 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:11.515893 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:11.519102 (+ 3209us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:38949: BlockingRecv error: recv got EOF from 127.26.189.129:38949 (error 108)
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":249,"threads_started":1}
Aug 06 02:18:11 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:11 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:11.722383 7958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:11.715443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:59185)
0806 02:18:11.715824 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:11.715840 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:11.715984 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:11.716304 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:11.716307 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:11.716535 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:11.716633 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:11.716638 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:11.717443 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:11.717449 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:11.718192 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:11.718203 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:11.718718 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:11.718722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:11.718813 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:11.719517 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:11.719530 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:11.722173 (+ 2643us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":120,"threads_started":1}
W20260806 02:18:11.722467 7957 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:11.715593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:59185 (local address 127.26.189.190:37637)
0806 02:18:11.715786 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:11.715791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:11.715933 (+ 142us) server_negotiation.cc:407] Connection header received
0806 02:18:11.716103 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:11.716106 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:11.716160 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:11.716266 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:11.716762 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:11.717325 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:11.718322 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:11.718550 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:11.718711 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:11.722372 (+ 3661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:59185: BlockingRecv error: recv got EOF from 127.26.189.130:59185 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 06 02:18:11 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:11 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:11.948647 7959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:11.936643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:37431)
0806 02:18:11.936931 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:11.936945 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:11.937037 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:11.937286 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:11.937289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:11.937476 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:11.937655 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:11.937662 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:11.938525 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:11.938528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:11.939151 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:11.939161 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:11.939609 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:11.939611 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:11.939679 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:11.946524 (+ 6845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:11.946542 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:11.948524 (+ 1982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":93,"threads_started":1}
W20260806 02:18:11.948848 7957 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:11.936781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:37431 (local address 127.26.189.190:37637)
0806 02:18:11.936932 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:11.936935 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:11.937042 (+ 107us) server_negotiation.cc:407] Connection header received
0806 02:18:11.937114 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:11.937116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:11.937172 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:11.937248 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:11.937763 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:11.938338 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:11.939276 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:11.939505 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:11.939586 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:11.948714 (+ 9128us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:37431: BlockingRecv error: recv got EOF from 127.26.189.131:37431 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 02:18:12 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:12 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:12.525964 7961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:12.519901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:49007)
0806 02:18:12.520207 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:12.520220 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:12.520356 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:12.520619 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:12.520622 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:12.520822 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:12.520921 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:12.520927 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:12.521747 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:12.521749 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:12.522514 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:12.522524 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:12.523030 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:12.523035 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:12.523129 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:12.523730 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:12.523743 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:12.525843 (+ 2100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":95,"threads_started":1}
W20260806 02:18:12.526230 7962 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:12.519906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:49007 (local address 127.26.189.190:37637)
0806 02:18:12.520201 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:12.520204 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:12.520322 (+ 118us) server_negotiation.cc:407] Connection header received
0806 02:18:12.520450 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:12.520452 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:12.520498 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:12.520573 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:12.521031 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:12.521636 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:12.522655 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:12.522889 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:12.522980 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:12.526022 (+ 3042us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:49007: BlockingRecv error: recv got EOF from 127.26.189.129:49007 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":92,"threads_started":1}
Aug 06 02:18:12 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:12 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:12.729125 7963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:12.723229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:60105)
0806 02:18:12.723546 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:12.723565 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:12.723730 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:12.724011 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:12.724014 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:12.724227 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:12.724331 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:12.724337 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:12.725139 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:12.725142 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:12.725793 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:12.725806 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:12.726379 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:12.726382 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:12.726456 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:12.727004 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:12.727016 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:12.728978 (+ 1962us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":103,"threads_started":1}
W20260806 02:18:12.729336 7962 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:12.723300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:60105 (local address 127.26.189.190:37637)
0806 02:18:12.723464 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:12.723471 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:12.723670 (+ 199us) server_negotiation.cc:407] Connection header received
0806 02:18:12.723819 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:12.723821 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:12.723867 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:12.723941 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:12.724458 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:12.725024 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:12.725936 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:12.726231 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:12.726349 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:12.729190 (+ 2841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:60105: BlockingRecv error: recv got EOF from 127.26.189.130:60105 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 06 02:18:12 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:12 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:12.955910 7964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:12.949523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:37055)
0806 02:18:12.949892 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:12.949909 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:12.950027 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:12.950314 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:12.950316 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:12.950522 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:12.950636 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:12.950642 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:12.951430 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:12.951433 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:12.952081 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:12.952091 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:12.952579 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:12.952582 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:12.952659 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:12.953187 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:12.953199 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:12.955673 (+ 2474us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":113,"threads_started":1}
W20260806 02:18:12.955910 7962 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:12.949668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:37055 (local address 127.26.189.190:37637)
0806 02:18:12.949814 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:12.949818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:12.949987 (+ 169us) server_negotiation.cc:407] Connection header received
0806 02:18:12.950172 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:12.950174 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:12.950222 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:12.950294 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:12.950758 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:12.951313 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:12.952218 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:12.952459 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:12.952544 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:12.955803 (+ 3259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:37055: BlockingRecv error: recv got EOF from 127.26.189.131:37055 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 02:18:13 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:13 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:13.533061 7965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:13.527167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:33065)
0806 02:18:13.527581 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:13.527599 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:13.527793 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:13.528153 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:13.528156 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:13.528399 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:13.528557 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:13.528566 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:13.529399 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:13.529401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:13.530007 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:13.530016 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:13.530465 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:13.530467 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:13.530532 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:13.531069 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:13.531081 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:13.532944 (+ 1863us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":94,"threads_started":1}
W20260806 02:18:13.533324 7966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:13.527304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:33065 (local address 127.26.189.190:37637)
0806 02:18:13.527606 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:13.527612 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:13.527715 (+ 103us) server_negotiation.cc:407] Connection header received
0806 02:18:13.527917 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:13.527919 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:13.527984 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:13.528093 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:13.528710 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:13.529289 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:13.530108 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:13.530357 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:13.530437 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:13.533183 (+ 2746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:33065: BlockingRecv error: recv got EOF from 127.26.189.129:33065 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":70,"threads_started":1}
Aug 06 02:18:13 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:13 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:13.736631 7967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:13.730090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:43449)
0806 02:18:13.730549 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:13.730576 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:13.730729 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:13.731076 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:13.731079 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:13.731335 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:13.731449 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:13.731456 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:13.732367 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:13.732373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:13.733032 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:13.733041 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:13.733680 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:13.733684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:13.733795 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:13.734330 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:13.734344 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:13.736482 (+ 2138us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":112,"threads_started":1}
W20260806 02:18:13.736757 7966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:13.730163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:43449 (local address 127.26.189.190:37637)
0806 02:18:13.730355 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:13.730361 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:13.730668 (+ 307us) server_negotiation.cc:407] Connection header received
0806 02:18:13.730859 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:13.730864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:13.730934 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:13.731040 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:13.731616 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:13.732233 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:13.733193 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:13.733473 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:13.733674 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:13.736632 (+ 2958us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:43449: BlockingRecv error: recv got EOF from 127.26.189.130:43449 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 06 02:18:13 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:13 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:13.962427 7968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:13.956741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:43559)
0806 02:18:13.957017 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:13.957031 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:13.957140 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:13.957498 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:13.957500 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:13.957754 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:13.957861 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:13.957868 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:13.958632 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:13.958635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:13.959201 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:13.959208 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:13.959615 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:13.959617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:13.959684 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:13.960259 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:13.960271 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:13.962232 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":74,"threads_started":1}
W20260806 02:18:13.962579 7966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:13.956841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:43559 (local address 127.26.189.190:37637)
0806 02:18:13.957025 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:13.957030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:13.957256 (+ 226us) server_negotiation.cc:407] Connection header received
0806 02:18:13.957301 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:13.957303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:13.957373 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:13.957445 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:13.957973 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:13.958535 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:13.959302 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:13.959518 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:13.959598 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:13.962427 (+ 2829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:43559: BlockingRecv error: recv got EOF from 127.26.189.131:43559 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 06 02:18:14 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:14 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:14.539577 7969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:14.534087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:40153)
0806 02:18:14.534382 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:14.534403 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:14.534507 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:14.534790 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:14.534793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:14.534990 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:14.535100 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:14.535107 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:14.535872 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:14.535875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:14.536460 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:14.536469 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:14.536892 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:14.536894 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:14.536957 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:14.537621 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:14.537634 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:14.539458 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":98,"threads_started":1}
W20260806 02:18:14.539774 7972 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:14.534126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:40153 (local address 127.26.189.190:37637)
0806 02:18:14.534404 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:14.534407 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:14.534458 (+ 51us) server_negotiation.cc:407] Connection header received
0806 02:18:14.534593 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:14.534596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:14.534640 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:14.534720 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:14.535213 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:14.535768 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:14.536565 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:14.536795 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:14.536871 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:14.539595 (+ 2724us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:40153: BlockingRecv error: recv got EOF from 127.26.189.129:40153 (error 108)
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":113,"threads_started":1}
Aug 06 02:18:14 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:14 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:14.743108 7973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:14.737723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:47057)
0806 02:18:14.738048 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:14.738061 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:14.738162 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:14.738403 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:14.738405 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:14.738607 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:14.738716 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:14.738721 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:14.739450 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:14.739453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:14.740009 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:14.740016 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:14.740429 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:14.740432 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:14.740498 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:14.741008 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:14.741019 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:14.742983 (+ 1964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":114,"threads_started":1}
W20260806 02:18:14.743247 7972 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:14.737903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:47057 (local address 127.26.189.190:37637)
0806 02:18:14.738062 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:14.738071 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:14.738111 (+ 40us) server_negotiation.cc:407] Connection header received
0806 02:18:14.738248 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:14.738250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:14.738294 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:14.738362 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:14.738818 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:14.739339 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:14.740110 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:14.740328 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:14.740403 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:14.743118 (+ 2715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:47057: BlockingRecv error: recv got EOF from 127.26.189.130:47057 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 06 02:18:14 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:14 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:14.968833 7975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:14.963253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:52913)
0806 02:18:14.963738 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:14.963753 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:14.963857 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:14.964090 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:14.964092 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:14.964297 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:14.964396 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:14.964401 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:14.965124 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:14.965126 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:14.965740 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:14.965749 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:14.966183 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:14.966186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:14.966247 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:14.966750 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:14.966762 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:14.968627 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":73,"threads_started":1}
W20260806 02:18:14.968983 7972 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:14.963346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:52913 (local address 127.26.189.190:37637)
0806 02:18:14.963527 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:14.963531 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:14.963825 (+ 294us) server_negotiation.cc:407] Connection header received
0806 02:18:14.963934 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:14.963936 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:14.963982 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:14.964049 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:14.964496 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:14.965031 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:14.965847 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:14.966065 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:14.966138 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:14.968809 (+ 2671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:52913: BlockingRecv error: recv got EOF from 127.26.189.131:52913 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 06 02:18:15 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:15 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:15.551193 7979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:15.540410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:55161)
0806 02:18:15.540707 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:15.540723 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:15.540825 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:15.541107 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:15.541109 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:15.541297 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:15.541394 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:15.541399 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:15.542218 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:15.542221 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:15.542807 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:15.542816 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:15.543432 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:15.543437 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:15.543543 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:15.548473 (+ 4930us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:15.548486 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:15.550975 (+ 2489us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":103,"threads_started":1}
W20260806 02:18:15.551391 7980 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:15.540551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:55161 (local address 127.26.189.190:37637)
0806 02:18:15.540880 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:15.540883 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:15.540897 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:18:15.540935 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:15.540937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:15.540978 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:15.541071 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:15.541509 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:15.542103 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:15.542937 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:15.543238 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:15.543358 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:15.551221 (+ 7863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:55161: BlockingRecv error: recv got EOF from 127.26.189.129:55161 (error 108)
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":105,"threads_started":1}
Aug 06 02:18:15 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:15 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:15.750164 7982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:15.744159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:58233)
0806 02:18:15.744472 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:15.744486 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:15.744625 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:15.744980 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:15.744984 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:15.745243 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:15.745377 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:15.745384 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:15.746291 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:15.746297 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:15.746886 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:15.746894 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:15.747385 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:15.747389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:15.747478 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:15.747996 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:15.748008 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:15.749965 (+ 1957us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":118,"threads_started":1}
W20260806 02:18:15.750335 7980 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:15.744229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:58233 (local address 127.26.189.190:37637)
0806 02:18:15.744387 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:15.744393 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:15.744571 (+ 178us) server_negotiation.cc:407] Connection header received
0806 02:18:15.744752 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:15.744756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:15.744835 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:15.744926 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:15.745515 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:15.746176 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:15.747009 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:15.747266 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:15.747381 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:15.750187 (+ 2806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:58233: BlockingRecv error: recv got EOF from 127.26.189.130:58233 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 06 02:18:15 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:15 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.131@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:15.975358 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:15.969678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.131:52851)
0806 02:18:15.970007 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:15.970021 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:15.970121 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:15.970368 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:15.970370 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:15.970555 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:15.970654 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:15.970659 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:15.971434 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:15.971437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:15.972021 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:15.972029 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:15.972458 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:15.972461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:15.972525 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:15.973077 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:15.973088 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:15.975169 (+ 2081us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":154,"threads_started":1}
W20260806 02:18:15.975422 7980 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:15.969674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:52851 (local address 127.26.189.190:37637)
0806 02:18:15.969829 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:15.969872 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:15.970122 (+ 250us) server_negotiation.cc:407] Connection header received
0806 02:18:15.970194 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:15.970196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:15.970252 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:15.970332 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:15.970787 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:15.971326 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:15.972125 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:15.972358 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:15.972437 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:15.975304 (+ 2867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.131:52851: BlockingRecv error: recv got EOF from 127.26.189.131:52851 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 02:18:16 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:16 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.129@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:16.558019 7984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:16.552250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.129:37135)
0806 02:18:16.552571 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:16.552586 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:16.552686 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:16.552911 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:16.552913 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:16.553095 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:16.553199 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:16.553205 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:16.554111 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:16.554114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:16.554749 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:16.554760 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:16.555262 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:16.555265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:16.555333 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:16.555819 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:16.555831 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:16.557836 (+ 2005us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":96,"threads_started":1}
W20260806 02:18:16.558094 7986 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:16.552336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:37135 (local address 127.26.189.190:37637)
0806 02:18:16.552617 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:16.552621 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:16.552635 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:18:16.552755 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:16.552758 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:16.552798 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:16.552875 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:16.553318 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:16.554006 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:16.554863 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:16.555143 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:16.555246 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:16.557967 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.129:37135: BlockingRecv error: recv got EOF from 127.26.189.129:37135 (error 108)
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":98,"threads_started":1}
Aug 06 02:18:16 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 02:18:16 dist-test-slave-gkw7 krb5kdc[6530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.189.130@KRBTEST.COM for oryx/127.26.189.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 02:18:16.757167 7987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:16.751203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37637 (local address 127.26.189.130:45349)
0806 02:18:16.751495 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:16.751509 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:16.751604 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:16.751848 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:16.751850 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:16.752048 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:16.752161 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:16.752167 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:16.753003 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:16.753006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:16.753728 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:16.753740 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:16.754235 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:16.754239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:16.754332 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:16.754865 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:16.754879 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:16.757042 (+ 2163us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.189.190:37637: Server oryx/127.26.189.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":78,"threads_started":1}
W20260806 02:18:16.757334 7986 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:16.751372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:45349 (local address 127.26.189.190:37637)
0806 02:18:16.751543 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:16.751547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:16.751562 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:18:16.751693 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:16.751695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:16.751737 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:16.751807 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:16.752310 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:16.752884 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:16.753859 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:16.754092 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:16.754209 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:16.757198 (+ 2989us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.189.130:45349: BlockingRecv error: recv got EOF from 127.26.189.130:45349 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 02:18:16.864117 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 7336
I20260806 02:18:16.875967 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 7538
I20260806 02:18:16.887909 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 7721
I20260806 02:18:16.895367 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 7236
2026-08-06T02:18:16Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18442 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T02:18:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:18:16Z Disabled control of system clock
I20260806 02:18:16.931811 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:46479
--webserver_interface=127.26.189.190
--webserver_port=0
--builtin_ntp_servers=127.26.189.148:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:46479
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 02:18:17.046253 7991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:17.046541 7991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:17.046576 7991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:17.050776 7991 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:18:17.050846 7991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:17.050863 7991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:17.050880 7991 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:18:17.050895 7991 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:18:17.055811 7991 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:46479
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:46479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:17.057044 7991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:17.058574 7991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 02:18:17.068270 7991 server_base.cc:1034] running on GCE node
W20260806 02:18:17.068308 7999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:17.068285 8001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:17.068259 8004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:17.069223 7991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:17.070425 7991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:17.071640 7991 hybrid_clock.cc:648] HybridClock initialized: now 1785982697071624 us; error 28 us; skew 500 ppm
I20260806 02:18:17.073848 7991 webserver.cc:460] Webserver started at http://127.26.189.190:44453/ using document root <none> and password file <none>
I20260806 02:18:17.074522 7991 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:17.074602 7991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:17.074857 7991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:17.077225 7991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "224da1f79e3a421b9519cff36f41da6d"
format_stamp: "Formatted at 2026-08-06 02:18:17 on dist-test-slave-gkw7"
server_key: "1129d69c3a3e799d185d71b7619ae1ff"
server_key_iv: "c6e79705f8f6e5f05f260d1a9b965630"
server_key_version: "encryptionkey@0"
I20260806 02:18:17.077940 7991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "224da1f79e3a421b9519cff36f41da6d"
format_stamp: "Formatted at 2026-08-06 02:18:17 on dist-test-slave-gkw7"
server_key: "1129d69c3a3e799d185d71b7619ae1ff"
server_key_iv: "c6e79705f8f6e5f05f260d1a9b965630"
server_key_version: "encryptionkey@0"
I20260806 02:18:17.082510 7991 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 02:18:17.085510 8013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:17.087095 7991 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:18:17.087276 7991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "224da1f79e3a421b9519cff36f41da6d"
format_stamp: "Formatted at 2026-08-06 02:18:17 on dist-test-slave-gkw7"
server_key: "1129d69c3a3e799d185d71b7619ae1ff"
server_key_iv: "c6e79705f8f6e5f05f260d1a9b965630"
server_key_version: "encryptionkey@0"
I20260806 02:18:17.087411 7991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:17.116883 7991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:17.117765 7991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:17.117978 7991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:17.125895 7991 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:46479
I20260806 02:18:17.125906 8084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:46479 every 8 connection(s)
I20260806 02:18:17.126928 7991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:18:17.128849 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 7991
I20260806 02:18:17.128966 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:18:17.129319 27382 external_mini_cluster.cc:1428] Setting key 3b03fcb6101453b732775b9d4bb0cbd5
I20260806 02:18:17.131708 8086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:18:17.138500 8086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d: Bootstrap starting.
I20260806 02:18:17.139256 8089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:17.130905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56414 (local address 127.26.189.190:46479)
0806 02:18:17.131554 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:17.131570 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:17.131607 (+ 37us) server_negotiation.cc:407] Connection header received
0806 02:18:17.132352 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:17.132370 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:17.132801 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:17.133098 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:17.133454 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.134553 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.135809 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.136276 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.136402 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:17.137343 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:17.137348 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:17.137360 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:18:17.137841 (+ 481us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:17.137900 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:18:17.137921 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:17.137999 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:17.138170 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 02:18:17.138476 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":142,"threads_started":1}
I20260806 02:18:17.140986 8086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d: Neither blocks nor log segments found. Creating new log.
I20260806 02:18:17.141886 8086 log.cc:824] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d: Log is configured to *not* fsync() on all Append() calls
I20260806 02:18:17.143867 8086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d: No bootstrap required, opened a new log
I20260806 02:18:17.147291 8086 raft_consensus.cc:348] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "224da1f79e3a421b9519cff36f41da6d" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46479 } }
I20260806 02:18:17.147504 8086 raft_consensus.cc:374] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:18:17.147547 8086 raft_consensus.cc:729] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 224da1f79e3a421b9519cff36f41da6d, State: Initialized, Role: FOLLOWER
I20260806 02:18:17.147951 8086 consensus_queue.cc:260] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "224da1f79e3a421b9519cff36f41da6d" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46479 } }
I20260806 02:18:17.148108 8086 raft_consensus.cc:388] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:18:17.148204 8086 raft_consensus.cc:482] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:18:17.148298 8086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:18:17.149272 8086 raft_consensus.cc:504] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "224da1f79e3a421b9519cff36f41da6d" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46479 } }
I20260806 02:18:17.149669 8086 leader_election.cc:302] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 224da1f79e3a421b9519cff36f41da6d; no voters:
I20260806 02:18:17.150003 8086 leader_election.cc:288] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:18:17.150199 8093 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:18:17.150585 8093 raft_consensus.cc:686] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [term 1 LEADER]: Becoming Leader. State: Replica: 224da1f79e3a421b9519cff36f41da6d, State: Running, Role: LEADER
I20260806 02:18:17.150967 8093 consensus_queue.cc:237] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "224da1f79e3a421b9519cff36f41da6d" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46479 } }
I20260806 02:18:17.151288 8086 sys_catalog.cc:564] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:18:17.152949 8096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 224da1f79e3a421b9519cff36f41da6d. Latest consensus state: current_term: 1 leader_uuid: "224da1f79e3a421b9519cff36f41da6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "224da1f79e3a421b9519cff36f41da6d" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46479 } } }
I20260806 02:18:17.152949 8095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "224da1f79e3a421b9519cff36f41da6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "224da1f79e3a421b9519cff36f41da6d" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 46479 } } }
I20260806 02:18:17.153128 8096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [sys.catalog]: This master's current role is: LEADER
I20260806 02:18:17.153136 8095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d [sys.catalog]: This master's current role is: LEADER
I20260806 02:18:17.153517 8113 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:18:17.156986 8113 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:18:17.162236 8113 catalog_manager.cc:1347] Generated new cluster ID: 82152f91b5524223bf5fa24bbb723073
I20260806 02:18:17.162312 8113 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:18:17.177359 8113 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:18:17.178431 8113 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:18:17.184414 8113 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 224da1f79e3a421b9519cff36f41da6d: Generated new TSK 0
I20260806 02:18:17.185118 8113 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:18:17.193817 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:46479
--builtin_ntp_servers=127.26.189.148:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 02:18:17.332180 8118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:17.332469 8118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:17.332540 8118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:17.336617 8118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:17.336705 8118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:17.336799 8118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:18:17.341616 8118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:46479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:17.342722 8118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:17.344101 8118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:17.353786 8124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:17.353835 8118 server_base.cc:1034] running on GCE node
W20260806 02:18:17.353824 8123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:17.354012 8127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:17.354382 8118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:17.355015 8118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:17.356212 8118 hybrid_clock.cc:648] HybridClock initialized: now 1785982697356199 us; error 29 us; skew 500 ppm
I20260806 02:18:17.358001 8118 webserver.cc:460] Webserver started at http://127.26.189.129:43429/ using document root <none> and password file <none>
I20260806 02:18:17.358608 8118 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:17.358706 8118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:17.358939 8118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:17.360978 8118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "17e645fba1044d38b3ceae6bbc903d38"
format_stamp: "Formatted at 2026-08-06 02:18:17 on dist-test-slave-gkw7"
server_key: "02dc2927c1f52227141226fbbb71af45"
server_key_iv: "0b1b631e309d5356310feee156dd068a"
server_key_version: "encryptionkey@0"
I20260806 02:18:17.361604 8118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "17e645fba1044d38b3ceae6bbc903d38"
format_stamp: "Formatted at 2026-08-06 02:18:17 on dist-test-slave-gkw7"
server_key: "02dc2927c1f52227141226fbbb71af45"
server_key_iv: "0b1b631e309d5356310feee156dd068a"
server_key_version: "encryptionkey@0"
I20260806 02:18:17.365141 8118 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 02:18:17.367592 8137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:17.368793 8118 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 02:18:17.368925 8118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "17e645fba1044d38b3ceae6bbc903d38"
format_stamp: "Formatted at 2026-08-06 02:18:17 on dist-test-slave-gkw7"
server_key: "02dc2927c1f52227141226fbbb71af45"
server_key_iv: "0b1b631e309d5356310feee156dd068a"
server_key_version: "encryptionkey@0"
I20260806 02:18:17.369037 8118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:17.408841 8118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:17.409682 8118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:17.409893 8118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:17.410516 8118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:17.411504 8118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:17.411579 8118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:17.411700 8118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:17.411754 8118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:17.421177 8118 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:39207
I20260806 02:18:17.421217 8287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:39207 every 8 connection(s)
I20260806 02:18:17.422174 8118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:18:17.422602 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 8118
I20260806 02:18:17.422724 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:18:17.423074 27382 external_mini_cluster.cc:1428] Setting key 28f6030debdf080d3e380cd1915b856f
I20260806 02:18:17.425554 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:46479
--builtin_ntp_servers=127.26.189.148:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 02:18:17.433316 8089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:17.424119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:36011 (local address 127.26.189.190:46479)
0806 02:18:17.424279 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:17.424283 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:17.425695 (+ 1412us) server_negotiation.cc:407] Connection header received
0806 02:18:17.427183 (+ 1488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:17.427190 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:17.427267 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:17.427386 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:17.428708 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.429544 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.430860 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.431268 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.431402 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:17.432680 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:17.432686 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:17.432690 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:18:17.432711 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:17.432739 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:18:17.432752 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:17.432840 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:17.432992 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 02:18:17.433096 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 02:18:17.434115 8291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:17.424696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:46479 (local address 127.26.189.129:36011)
0806 02:18:17.425492 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:17.425575 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:17.426951 (+ 1376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:17.427638 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:17.427649 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:17.427766 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:17.428509 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:17.428533 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.429705 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.429708 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:17.430713 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:17.430725 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.431442 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.431446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:17.431633 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:17.432381 (+ 748us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:18:17.432383 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:17.432435 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:18:17.432501 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:18:17.432846 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:18:17.432853 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:18:17.432857 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 02:18:17.432954 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 02:18:17.433215 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":167,"threads_started":1}
I20260806 02:18:17.435475 8289 heartbeater.cc:347] Connected to a master server at 127.26.189.190:46479
I20260806 02:18:17.435772 8289 heartbeater.cc:464] Registering TS with master...
I20260806 02:18:17.436483 8289 heartbeater.cc:511] Master 127.26.189.190:46479 requested a full tablet report, sending...
I20260806 02:18:17.438210 8038 ts_manager.cc:194] Registered new tserver with Master: 17e645fba1044d38b3ceae6bbc903d38 (127.26.189.129:39207)
I20260806 02:18:17.439399 8038 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.189.129:36011
W20260806 02:18:17.542614 8293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:17.542915 8293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:17.542986 8293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:17.547103 8293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:17.547191 8293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:17.547279 8293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:18:17.552534 8293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:46479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:17.553813 8293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:17.555254 8293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:17.565436 8304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:17.565492 8301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:17.565492 8300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:17.565733 8293 server_base.cc:1034] running on GCE node
I20260806 02:18:17.566320 8293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:17.566987 8293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:17.568203 8293 hybrid_clock.cc:648] HybridClock initialized: now 1785982697568174 us; error 42 us; skew 500 ppm
I20260806 02:18:17.570328 8293 webserver.cc:460] Webserver started at http://127.26.189.130:36705/ using document root <none> and password file <none>
I20260806 02:18:17.570940 8293 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:17.571038 8293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:17.571280 8293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:17.573458 8293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "86675a0de0e94fed8e6c42712864d8f3"
format_stamp: "Formatted at 2026-08-06 02:18:17 on dist-test-slave-gkw7"
server_key: "48be078d330413de65399c96b6818abd"
server_key_iv: "4351af7e864488a2736dd878b857b90c"
server_key_version: "encryptionkey@0"
I20260806 02:18:17.574096 8293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "86675a0de0e94fed8e6c42712864d8f3"
format_stamp: "Formatted at 2026-08-06 02:18:17 on dist-test-slave-gkw7"
server_key: "48be078d330413de65399c96b6818abd"
server_key_iv: "4351af7e864488a2736dd878b857b90c"
server_key_version: "encryptionkey@0"
I20260806 02:18:17.577811 8293 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:18:17.580442 8312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:17.581804 8293 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:18:17.581938 8293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "86675a0de0e94fed8e6c42712864d8f3"
format_stamp: "Formatted at 2026-08-06 02:18:17 on dist-test-slave-gkw7"
server_key: "48be078d330413de65399c96b6818abd"
server_key_iv: "4351af7e864488a2736dd878b857b90c"
server_key_version: "encryptionkey@0"
I20260806 02:18:17.582050 8293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:17.595208 8293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:17.595883 8293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:17.596107 8293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:17.596701 8293 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:17.597846 8293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:17.597919 8293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:17.598012 8293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:17.598066 8293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:17.606958 8293 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:44421
I20260806 02:18:17.606985 8460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:44421 every 8 connection(s)
I20260806 02:18:17.607960 8293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:18:17.613782 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 8293
I20260806 02:18:17.613925 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:18:17.614251 27382 external_mini_cluster.cc:1428] Setting key 62942da7192e39f44f13b6bc9caba097
I20260806 02:18:17.616506 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:46479
--builtin_ntp_servers=127.26.189.148:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 02:18:17.618096 8089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:17.609930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:46125 (local address 127.26.189.190:46479)
0806 02:18:17.610084 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:17.610088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:17.611177 (+ 1089us) server_negotiation.cc:407] Connection header received
0806 02:18:17.612547 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:17.612550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:17.612601 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:17.612683 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:17.613659 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.614323 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.615818 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.616052 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.616134 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:17.617429 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:17.617433 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:17.617435 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:18:17.617448 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:17.617468 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:18:17.617477 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:17.617708 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:17.617930 (+ 222us) server_negotiation.cc:299] Negotiation successful
0806 02:18:17.617985 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 02:18:17.619119 8463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:17.610339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:46479 (local address 127.26.189.130:46125)
0806 02:18:17.610991 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:17.611032 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:17.612328 (+ 1296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:17.612865 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:17.612872 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:17.612956 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:17.613440 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:17.613485 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.614481 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.614484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:17.615699 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:17.615708 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.616215 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.616221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:17.616447 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:17.617094 (+ 647us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:18:17.617099 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:17.617156 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:18:17.617244 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:18:17.617729 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:18:17.617742 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:18:17.617752 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 02:18:17.617895 (+ 143us) client_negotiation.cc:240] Negotiation successful
0806 02:18:17.618214 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":101,"threads_started":1}
I20260806 02:18:17.620409 8461 heartbeater.cc:347] Connected to a master server at 127.26.189.190:46479
I20260806 02:18:17.620679 8461 heartbeater.cc:464] Registering TS with master...
I20260806 02:18:17.621204 8461 heartbeater.cc:511] Master 127.26.189.190:46479 requested a full tablet report, sending...
I20260806 02:18:17.622515 8038 ts_manager.cc:194] Registered new tserver with Master: 86675a0de0e94fed8e6c42712864d8f3 (127.26.189.130:44421)
I20260806 02:18:17.623410 8038 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.189.130:46125
W20260806 02:18:17.733912 8464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:17.734179 8464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:17.734217 8464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:17.738266 8464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:17.738317 8464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:17.738369 8464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:18:17.742964 8464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:46479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:17.743992 8464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:17.745366 8464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:17.755384 8478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:17.755388 8474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:17.755719 8464 server_base.cc:1034] running on GCE node
W20260806 02:18:17.755425 8476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:17.756142 8464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:17.756824 8464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:17.758018 8464 hybrid_clock.cc:648] HybridClock initialized: now 1785982697758001 us; error 25 us; skew 500 ppm
I20260806 02:18:17.759910 8464 webserver.cc:460] Webserver started at http://127.26.189.131:40653/ using document root <none> and password file <none>
I20260806 02:18:17.760504 8464 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:17.760598 8464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:17.760844 8464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:17.763022 8464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "6e9c779e0c6549fe8f9412c9938a2fca"
format_stamp: "Formatted at 2026-08-06 02:18:17 on dist-test-slave-gkw7"
server_key: "862a8f8dd5e828aecc7cfb5f04bc40cb"
server_key_iv: "7188722a3117c99fbbf89c7f5e178426"
server_key_version: "encryptionkey@0"
I20260806 02:18:17.763599 8464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "6e9c779e0c6549fe8f9412c9938a2fca"
format_stamp: "Formatted at 2026-08-06 02:18:17 on dist-test-slave-gkw7"
server_key: "862a8f8dd5e828aecc7cfb5f04bc40cb"
server_key_iv: "7188722a3117c99fbbf89c7f5e178426"
server_key_version: "encryptionkey@0"
I20260806 02:18:17.767310 8464 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 02:18:17.769961 8486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:17.771241 8464 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:18:17.771394 8464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "6e9c779e0c6549fe8f9412c9938a2fca"
format_stamp: "Formatted at 2026-08-06 02:18:17 on dist-test-slave-gkw7"
server_key: "862a8f8dd5e828aecc7cfb5f04bc40cb"
server_key_iv: "7188722a3117c99fbbf89c7f5e178426"
server_key_version: "encryptionkey@0"
I20260806 02:18:17.771517 8464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:17.794468 8464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:17.795185 8464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:17.795389 8464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:17.795997 8464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:17.796975 8464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:17.797047 8464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:17.797119 8464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:17.797174 8464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:17.806473 8464 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:36173
I20260806 02:18:17.806497 8644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:36173 every 8 connection(s)
I20260806 02:18:17.807435 8464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:18:17.814751 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 8464
I20260806 02:18:17.814885 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:18:17.815166 27382 external_mini_cluster.cc:1428] Setting key ac00a5a7ffc20284e656d1752e966ae1
I20260806 02:18:17.817026 8089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:17.809378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:51687 (local address 127.26.189.190:46479)
0806 02:18:17.809523 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:17.809572 (+ 49us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:17.810656 (+ 1084us) server_negotiation.cc:407] Connection header received
0806 02:18:17.812056 (+ 1400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:17.812059 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:17.812121 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:17.812234 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:17.813125 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.813698 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.814898 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.815174 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.815304 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:17.816543 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:17.816547 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:17.816549 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:18:17.816563 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:17.816586 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:18:17.816596 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:17.816690 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:17.816872 (+ 182us) server_negotiation.cc:299] Negotiation successful
0806 02:18:17.816921 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 02:18:17.818012 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:17.809806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:46479 (local address 127.26.189.131:51687)
0806 02:18:17.810486 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:17.810527 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:17.811836 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:17.812414 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:17.812421 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:17.812500 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:17.812971 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:17.812982 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.813828 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.813845 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:17.814764 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:17.814774 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:17.815408 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:17.815413 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:17.815603 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:17.816241 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:18:17.816242 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:17.816285 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:18:17.816382 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:18:17.816723 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:18:17.816732 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:18:17.816739 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 02:18:17.816861 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 02:18:17.817143 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":112,"threads_started":1}
I20260806 02:18:17.818989 8647 heartbeater.cc:347] Connected to a master server at 127.26.189.190:46479
I20260806 02:18:17.819248 8647 heartbeater.cc:464] Registering TS with master...
I20260806 02:18:17.819766 8647 heartbeater.cc:511] Master 127.26.189.190:46479 requested a full tablet report, sending...
I20260806 02:18:17.821137 8038 ts_manager.cc:194] Registered new tserver with Master: 6e9c779e0c6549fe8f9412c9938a2fca (127.26.189.131:36173)
I20260806 02:18:17.821950 8038 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.189.131:51687
I20260806 02:18:17.829231 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 02:18:17.832325 8089 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:17.831271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56416 (local address 127.26.189.190:46479)
0806 02:18:17.831476 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:17.831480 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:17.831628 (+ 148us) server_negotiation.cc:407] Connection header received
0806 02:18:17.831800 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:17.831803 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:17.831854 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:17.831953 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:17.832229 (+ 276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56416: BlockingRecv error: recv got EOF from 127.0.0.1:56416 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
I20260806 02:18:17.833081 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 8118
I20260806 02:18:17.851586 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 8293
I20260806 02:18:17.861747 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 8464
I20260806 02:18:17.872867 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 7991
2026-08-06T02:18:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (976 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T02:18:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:18:17Z Disabled control of system clock
I20260806 02:18:17.908505 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39013
--webserver_interface=127.26.189.190
--webserver_port=0
--builtin_ntp_servers=127.26.189.148:39423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:39013
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 02:18:18.022049 8659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:18.022337 8659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:18.022377 8659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:18.026522 8659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:18:18.026582 8659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:18.026597 8659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:18.026615 8659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:18:18.026630 8659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:18:18.031430 8659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:39013
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:18.032588 8659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:18.034168 8659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:18.042786 8664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:18.042896 8659 server_base.cc:1034] running on GCE node
W20260806 02:18:18.042795 8668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:18.042795 8665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:18.043676 8659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:18.044831 8659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:18.045990 8659 hybrid_clock.cc:648] HybridClock initialized: now 1785982698045955 us; error 51 us; skew 500 ppm
I20260806 02:18:18.047989 8659 webserver.cc:460] Webserver started at http://127.26.189.190:46503/ using document root <none> and password file <none>
I20260806 02:18:18.048610 8659 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:18.048678 8659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:18.048904 8659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:18.051091 8659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "4455f4cd107a4b6fa61d4e0f5f9b5f10"
format_stamp: "Formatted at 2026-08-06 02:18:18 on dist-test-slave-gkw7"
server_key: "9e401d6814739eb8eb1e423978d90756"
server_key_iv: "22ad05c401300ae3850bfc3b12241dc7"
server_key_version: "encryptionkey@0"
I20260806 02:18:18.051693 8659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "4455f4cd107a4b6fa61d4e0f5f9b5f10"
format_stamp: "Formatted at 2026-08-06 02:18:18 on dist-test-slave-gkw7"
server_key: "9e401d6814739eb8eb1e423978d90756"
server_key_iv: "22ad05c401300ae3850bfc3b12241dc7"
server_key_version: "encryptionkey@0"
I20260806 02:18:18.055720 8659 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:18:18.058455 8674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:18.059779 8659 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:18:18.059943 8659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "4455f4cd107a4b6fa61d4e0f5f9b5f10"
format_stamp: "Formatted at 2026-08-06 02:18:18 on dist-test-slave-gkw7"
server_key: "9e401d6814739eb8eb1e423978d90756"
server_key_iv: "22ad05c401300ae3850bfc3b12241dc7"
server_key_version: "encryptionkey@0"
I20260806 02:18:18.060077 8659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:18.065042 8659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:18.065783 8659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:18.065979 8659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:18.073205 8659 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:39013
I20260806 02:18:18.073272 8752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:39013 every 8 connection(s)
I20260806 02:18:18.074326 8659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:18:18.074647 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 8659
I20260806 02:18:18.074800 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:18:18.075203 27382 external_mini_cluster.cc:1428] Setting key b46a37423e59b492c134681352f32d7c
I20260806 02:18:18.077775 8753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:18:18.081930 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:18.076698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34606 (local address 127.26.189.190:39013)
0806 02:18:18.077875 (+ 1177us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:18.077895 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:18.077939 (+ 44us) server_negotiation.cc:407] Connection header received
0806 02:18:18.078796 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:18.078819 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:18.079269 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:18.079635 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:18.080380 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:18.080385 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:18.080401 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:18:18.080412 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:18.080476 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:18:18.080499 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:18.080644 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:18.080714 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 02:18:18.080969 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":516,"threads_started":1}
I20260806 02:18:18.084707 8753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10: Bootstrap starting.
I20260806 02:18:18.086812 8753 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10: Neither blocks nor log segments found. Creating new log.
I20260806 02:18:18.087478 8753 log.cc:824] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10: Log is configured to *not* fsync() on all Append() calls
I20260806 02:18:18.089458 8753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10: No bootstrap required, opened a new log
I20260806 02:18:18.093061 8753 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4455f4cd107a4b6fa61d4e0f5f9b5f10" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39013 } }
I20260806 02:18:18.093267 8753 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:18:18.093302 8753 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4455f4cd107a4b6fa61d4e0f5f9b5f10, State: Initialized, Role: FOLLOWER
I20260806 02:18:18.093740 8753 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4455f4cd107a4b6fa61d4e0f5f9b5f10" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39013 } }
I20260806 02:18:18.093866 8753 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:18:18.093912 8753 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:18:18.093986 8753 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:18:18.094805 8753 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4455f4cd107a4b6fa61d4e0f5f9b5f10" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39013 } }
I20260806 02:18:18.095089 8753 leader_election.cc:302] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4455f4cd107a4b6fa61d4e0f5f9b5f10; no voters:
I20260806 02:18:18.095335 8753 leader_election.cc:288] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:18:18.095468 8758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:18:18.095714 8758 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [term 1 LEADER]: Becoming Leader. State: Replica: 4455f4cd107a4b6fa61d4e0f5f9b5f10, State: Running, Role: LEADER
I20260806 02:18:18.096094 8758 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4455f4cd107a4b6fa61d4e0f5f9b5f10" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39013 } }
I20260806 02:18:18.096619 8753 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:18:18.098120 8760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4455f4cd107a4b6fa61d4e0f5f9b5f10. Latest consensus state: current_term: 1 leader_uuid: "4455f4cd107a4b6fa61d4e0f5f9b5f10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4455f4cd107a4b6fa61d4e0f5f9b5f10" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39013 } } }
I20260806 02:18:18.098321 8760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [sys.catalog]: This master's current role is: LEADER
I20260806 02:18:18.098407 8759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4455f4cd107a4b6fa61d4e0f5f9b5f10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4455f4cd107a4b6fa61d4e0f5f9b5f10" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39013 } } }
I20260806 02:18:18.098556 8759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10 [sys.catalog]: This master's current role is: LEADER
I20260806 02:18:18.099227 8768 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:18:18.102442 8768 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:18:18.108206 8768 catalog_manager.cc:1347] Generated new cluster ID: 2736a8b11dc349ef86fcca9f124ddb3f
I20260806 02:18:18.108283 8768 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:18:18.147418 8768 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:18:18.147783 8768 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:18:18.156766 8768 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4455f4cd107a4b6fa61d4e0f5f9b5f10: Generated new TSK 0
I20260806 02:18:18.157577 8768 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:18:18.163456 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39013
--builtin_ntp_servers=127.26.189.148:39423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 02:18:18.283262 8782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:18.283530 8782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:18.283574 8782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:18.287659 8782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:18.287719 8782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:18.287773 8782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:18:18.292757 8782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:18.293946 8782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:18.295389 8782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:18.305421 8788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:18.305416 8789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:18.305416 8791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:18.305882 8782 server_base.cc:1034] running on GCE node
I20260806 02:18:18.306308 8782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:18.306955 8782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:18.308120 8782 hybrid_clock.cc:648] HybridClock initialized: now 1785982698308103 us; error 27 us; skew 500 ppm
I20260806 02:18:18.309983 8782 webserver.cc:460] Webserver started at http://127.26.189.129:43505/ using document root <none> and password file <none>
I20260806 02:18:18.310578 8782 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:18.310642 8782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:18.310859 8782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:18.312933 8782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "cb4fc4b8569546bb8ff43c0436debb2a"
format_stamp: "Formatted at 2026-08-06 02:18:18 on dist-test-slave-gkw7"
server_key: "61a165f14839ba4cae2e93ff22bd5f67"
server_key_iv: "90e0ce5cd365e460b3f3b9e9d9aa08da"
server_key_version: "encryptionkey@0"
I20260806 02:18:18.313509 8782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "cb4fc4b8569546bb8ff43c0436debb2a"
format_stamp: "Formatted at 2026-08-06 02:18:18 on dist-test-slave-gkw7"
server_key: "61a165f14839ba4cae2e93ff22bd5f67"
server_key_iv: "90e0ce5cd365e460b3f3b9e9d9aa08da"
server_key_version: "encryptionkey@0"
I20260806 02:18:18.317195 8782 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:18:18.320560 8801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:18.322373 8782 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:18:18.322502 8782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "cb4fc4b8569546bb8ff43c0436debb2a"
format_stamp: "Formatted at 2026-08-06 02:18:18 on dist-test-slave-gkw7"
server_key: "61a165f14839ba4cae2e93ff22bd5f67"
server_key_iv: "90e0ce5cd365e460b3f3b9e9d9aa08da"
server_key_version: "encryptionkey@0"
I20260806 02:18:18.322643 8782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:18.329713 8782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:18.330542 8782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:18.330741 8782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:18.331475 8782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:18.332428 8782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:18.332476 8782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:18.332515 8782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:18.332568 8782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:18.342164 8782 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:37431
I20260806 02:18:18.342200 8951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:37431 every 8 connection(s)
I20260806 02:18:18.343091 8782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:18:18.349323 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:18.345029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:38979 (local address 127.26.189.190:39013)
0806 02:18:18.345181 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:18.345186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:18.346334 (+ 1148us) server_negotiation.cc:407] Connection header received
0806 02:18:18.347659 (+ 1325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:18.347663 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:18.347706 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:18.347790 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:18.348824 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:18.348827 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:18.348830 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:18:18.348842 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:18.348871 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:18:18.348880 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:18.348978 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:18.349135 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 02:18:18.349190 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 02:18:18.350217 8955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:18.345463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39013 (local address 127.26.189.129:38979)
0806 02:18:18.346181 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:18.346222 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:18.347443 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:18.347949 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:18.347956 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:18.348041 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:18.348563 (+ 522us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:18:18.348565 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:18.348605 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:18:18.348675 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:18:18.348971 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:18:18.348981 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:18:18.348989 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 02:18:18.349168 (+ 179us) client_negotiation.cc:240] Negotiation successful
0806 02:18:18.349400 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":116,"threads_started":1}
I20260806 02:18:18.351444 8953 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39013
I20260806 02:18:18.351693 8953 heartbeater.cc:464] Registering TS with master...
I20260806 02:18:18.351681 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 8782
I20260806 02:18:18.351796 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:18:18.352133 27382 external_mini_cluster.cc:1428] Setting key 4b8b4fdb621390668404b9d50897754d
I20260806 02:18:18.352216 8953 heartbeater.cc:511] Master 127.26.189.190:39013 requested a full tablet report, sending...
I20260806 02:18:18.353832 8699 ts_manager.cc:194] Registered new tserver with Master: cb4fc4b8569546bb8ff43c0436debb2a (127.26.189.129:37431)
I20260806 02:18:18.354189 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39013
--builtin_ntp_servers=127.26.189.148:39423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 02:18:18.472687 8956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:18.472931 8956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:18.472970 8956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:18.476930 8956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:18.476985 8956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:18.477039 8956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:18:18.481856 8956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:18.482877 8956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:18.484267 8956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:18.494171 8966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:18.494159 8964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:18.494395 8956 server_base.cc:1034] running on GCE node
W20260806 02:18:18.494159 8963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:18.494843 8956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:18.495533 8956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:18.496743 8956 hybrid_clock.cc:648] HybridClock initialized: now 1785982698496724 us; error 30 us; skew 500 ppm
I20260806 02:18:18.498973 8956 webserver.cc:460] Webserver started at http://127.26.189.130:33651/ using document root <none> and password file <none>
I20260806 02:18:18.499687 8956 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:18.499783 8956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:18.500006 8956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:18.502359 8956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "98d6eedd646242f697a8bee546ebc9c8"
format_stamp: "Formatted at 2026-08-06 02:18:18 on dist-test-slave-gkw7"
server_key: "2b90202386727eed689966ccb36454ef"
server_key_iv: "f0f11d42022dff992727dea1a17c9c14"
server_key_version: "encryptionkey@0"
I20260806 02:18:18.502939 8956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "98d6eedd646242f697a8bee546ebc9c8"
format_stamp: "Formatted at 2026-08-06 02:18:18 on dist-test-slave-gkw7"
server_key: "2b90202386727eed689966ccb36454ef"
server_key_iv: "f0f11d42022dff992727dea1a17c9c14"
server_key_version: "encryptionkey@0"
I20260806 02:18:18.506685 8956 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260806 02:18:18.509289 8973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:18.510576 8956 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:18:18.510718 8956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "98d6eedd646242f697a8bee546ebc9c8"
format_stamp: "Formatted at 2026-08-06 02:18:18 on dist-test-slave-gkw7"
server_key: "2b90202386727eed689966ccb36454ef"
server_key_iv: "f0f11d42022dff992727dea1a17c9c14"
server_key_version: "encryptionkey@0"
I20260806 02:18:18.510838 8956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:18.515497 8956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:18.516115 8956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:18.516315 8956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:18.516861 8956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:18.517851 8956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:18.517922 8956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:18.517993 8956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:18.518045 8956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:18.526988 8956 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:34957
I20260806 02:18:18.527011 9124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:34957 every 8 connection(s)
I20260806 02:18:18.528057 8956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:18:18.531605 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 8956
I20260806 02:18:18.531764 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:18:18.532064 27382 external_mini_cluster.cc:1428] Setting key 01ba0a09ac5854c742b34ce6994e7ec5
I20260806 02:18:18.534278 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39013
--builtin_ntp_servers=127.26.189.148:39423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 02:18:18.534909 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:18.530094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:59853 (local address 127.26.189.190:39013)
0806 02:18:18.530288 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:18.530292 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:18.531374 (+ 1082us) server_negotiation.cc:407] Connection header received
0806 02:18:18.532959 (+ 1585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:18.532962 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:18.533003 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:18.533081 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:18.534386 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:18.534390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:18.534395 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:18:18.534412 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:18.534436 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:18:18.534446 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:18.534537 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:18.534721 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 02:18:18.534769 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 02:18:18.535815 9127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:18.530496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39013 (local address 127.26.189.130:59853)
0806 02:18:18.531204 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:18.531247 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:18.532723 (+ 1476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:18.533259 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:18.533266 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:18.533359 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:18.534116 (+ 757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:18:18.534117 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:18.534163 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:18:18.534235 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:18:18.534543 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:18:18.534554 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:18:18.534560 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 02:18:18.534757 (+ 197us) client_negotiation.cc:240] Negotiation successful
0806 02:18:18.535015 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":132,"threads_started":1}
I20260806 02:18:18.537024 9125 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39013
I20260806 02:18:18.537333 9125 heartbeater.cc:464] Registering TS with master...
I20260806 02:18:18.537837 9125 heartbeater.cc:511] Master 127.26.189.190:39013 requested a full tablet report, sending...
I20260806 02:18:18.538973 8699 ts_manager.cc:194] Registered new tserver with Master: 98d6eedd646242f697a8bee546ebc9c8 (127.26.189.130:34957)
W20260806 02:18:18.654260 9128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:18.654506 9128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:18.654546 9128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:18.658488 9128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:18.658540 9128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:18.658593 9128 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:18:18.663352 9128 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:18.664530 9128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:18.665979 9128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 02:18:18.675933 9128 server_base.cc:1034] running on GCE node
W20260806 02:18:18.675860 9140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:18.675901 9137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:18.675860 9136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:18.676570 9128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:18.677281 9128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:18.678469 9128 hybrid_clock.cc:648] HybridClock initialized: now 1785982698678433 us; error 49 us; skew 500 ppm
I20260806 02:18:18.680408 9128 webserver.cc:460] Webserver started at http://127.26.189.131:36593/ using document root <none> and password file <none>
I20260806 02:18:18.681010 9128 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:18.681106 9128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:18.681363 9128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:18.683565 9128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "eae296cf4d31459d8756c116c132f02a"
format_stamp: "Formatted at 2026-08-06 02:18:18 on dist-test-slave-gkw7"
server_key: "6815591c775bdaea48c2479b6366499e"
server_key_iv: "03c7ae99686b777a6bfea36a50abbabd"
server_key_version: "encryptionkey@0"
I20260806 02:18:18.684181 9128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "eae296cf4d31459d8756c116c132f02a"
format_stamp: "Formatted at 2026-08-06 02:18:18 on dist-test-slave-gkw7"
server_key: "6815591c775bdaea48c2479b6366499e"
server_key_iv: "03c7ae99686b777a6bfea36a50abbabd"
server_key_version: "encryptionkey@0"
I20260806 02:18:18.688094 9128 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 02:18:18.690888 9146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:18.692128 9128 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 02:18:18.692276 9128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "eae296cf4d31459d8756c116c132f02a"
format_stamp: "Formatted at 2026-08-06 02:18:18 on dist-test-slave-gkw7"
server_key: "6815591c775bdaea48c2479b6366499e"
server_key_iv: "03c7ae99686b777a6bfea36a50abbabd"
server_key_version: "encryptionkey@0"
I20260806 02:18:18.692399 9128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:18.697999 9128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:18.698658 9128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:18.698889 9128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:18.699640 9128 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:18.700603 9128 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:18.700676 9128 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:18.700742 9128 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:18.700773 9128 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:18.709762 9128 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:40863
I20260806 02:18:18.709800 9300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:40863 every 8 connection(s)
I20260806 02:18:18.710708 9128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:18:18.711809 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 9128
I20260806 02:18:18.711894 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:18:18.712246 27382 external_mini_cluster.cc:1428] Setting key 423f73365d71f0c062e86db1494c63b4
I20260806 02:18:18.717658 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:18.712644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:39059 (local address 127.26.189.190:39013)
0806 02:18:18.712786 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:18.712791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:18.714212 (+ 1421us) server_negotiation.cc:407] Connection header received
0806 02:18:18.715858 (+ 1646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:18.715861 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:18.715905 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:18.715977 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:18.717132 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:18.717135 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:18.717138 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:18:18.717160 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:18.717188 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:18:18.717197 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:18.717289 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:18.717455 (+ 166us) server_negotiation.cc:299] Negotiation successful
0806 02:18:18.717502 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 02:18:18.718505 9303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:18.713174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39013 (local address 127.26.189.131:39059)
0806 02:18:18.714051 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:18.714120 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:18.715651 (+ 1531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:18.716153 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:18.716160 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:18.716252 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:18.716865 (+ 613us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:18:18.716866 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:18.716915 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:18:18.716982 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:18:18.717289 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:18:18.717301 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:18:18.717309 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 02:18:18.717490 (+ 181us) client_negotiation.cc:240] Negotiation successful
0806 02:18:18.717767 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":139,"threads_started":1}
I20260806 02:18:18.719524 9301 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39013
I20260806 02:18:18.719738 9301 heartbeater.cc:464] Registering TS with master...
I20260806 02:18:18.720091 9301 heartbeater.cc:511] Master 127.26.189.190:39013 requested a full tablet report, sending...
I20260806 02:18:18.721026 8699 ts_manager.cc:194] Registered new tserver with Master: eae296cf4d31459d8756c116c132f02a (127.26.189.131:40863)
I20260806 02:18:18.726282 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 02:18:18.729286 8756 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:18:18.728253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34614 (local address 127.26.189.190:39013)
0806 02:18:18.728415 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:18.728422 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:18.728633 (+ 211us) server_negotiation.cc:407] Connection header received
0806 02:18:18.728789 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:18.728792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:18.728828 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:18.728921 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:18.729162 (+ 241us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34614: BlockingRecv error: recv got EOF from 127.0.0.1:34614 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 02:18:18.729420 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 8782
I20260806 02:18:18.741878 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 8956
I20260806 02:18:18.761204 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 9128
I20260806 02:18:18.771812 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 8659
2026-08-06T02:18:18Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (898 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:18:18 dist-test-slave-gkw7 krb5kdc[9312](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:18:18 dist-test-slave-gkw7 krb5kdc[9312](info): set up 2 sockets
Aug 06 02:18:18 dist-test-slave-gkw7 krb5kdc[9312](info): commencing operation
krb5kdc: starting...
W20260806 02:18:19.983132 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:18:20 dist-test-slave-gkw7 krb5kdc[9312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:18:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:18:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:18:20.121177 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:37169
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:34921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:37169
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:18:20.244412 9329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:20.244724 9329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:20.244766 9329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:20.248912 9329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:18:20.248978 9329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:20.248998 9329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:20.249015 9329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:18:20.249030 9329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:18:20.254531 9329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:37169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:37169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:20.255612 9329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:20.256641 9329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:20.265708 9338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:20.265708 9341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:20.265928 9329 server_base.cc:1034] running on GCE node
W20260806 02:18:20.265792 9339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:20.266593 9329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:20.267709 9329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:20.268889 9329 hybrid_clock.cc:648] HybridClock initialized: now 1785982700268869 us; error 31 us; skew 500 ppm
Aug 06 02:18:20 dist-test-slave-gkw7 krb5kdc[9312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982700, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:18:20.271988 9329 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:18:20.272965 9329 webserver.cc:460] Webserver started at http://127.26.189.190:34627/ using document root <none> and password file <none>
I20260806 02:18:20.273631 9329 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:20.273703 9329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:20.273948 9329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:20.276039 9329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "061c8180efce4f8597e4db20346e269a"
format_stamp: "Formatted at 2026-08-06 02:18:20 on dist-test-slave-gkw7"
server_key: "7f8b4736c1e5d8791268eacc0a1cb43e"
server_key_iv: "af1ef06ff9ddccce8f5318567ae435b0"
server_key_version: "encryptionkey@0"
I20260806 02:18:20.276626 9329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "061c8180efce4f8597e4db20346e269a"
format_stamp: "Formatted at 2026-08-06 02:18:20 on dist-test-slave-gkw7"
server_key: "7f8b4736c1e5d8791268eacc0a1cb43e"
server_key_iv: "af1ef06ff9ddccce8f5318567ae435b0"
server_key_version: "encryptionkey@0"
I20260806 02:18:20.280552 9329 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:18:20.283164 9349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:20.284489 9329 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 02:18:20.284636 9329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "061c8180efce4f8597e4db20346e269a"
format_stamp: "Formatted at 2026-08-06 02:18:20 on dist-test-slave-gkw7"
server_key: "7f8b4736c1e5d8791268eacc0a1cb43e"
server_key_iv: "af1ef06ff9ddccce8f5318567ae435b0"
server_key_version: "encryptionkey@0"
I20260806 02:18:20.284755 9329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:20.345664 9329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:20.348893 9329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:20.349133 9329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:20.357164 9329 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:37169
I20260806 02:18:20.357213 9423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:37169 every 8 connection(s)
I20260806 02:18:20.358208 9329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:18:20.359706 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 9329
I20260806 02:18:20.359831 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:18:20.360157 27382 external_mini_cluster.cc:1428] Setting key 55a16d1cebcff2533842c0e620369e14
I20260806 02:18:20.361644 9424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:18:20.368458 9424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a: Bootstrap starting.
Aug 06 02:18:20 dist-test-slave-gkw7 krb5kdc[9312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:18:20.371178 9424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a: Neither blocks nor log segments found. Creating new log.
I20260806 02:18:20.371981 9424 log.cc:824] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a: Log is configured to *not* fsync() on all Append() calls
I20260806 02:18:20.374406 9424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a: No bootstrap required, opened a new log
I20260806 02:18:20.375427 9428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:20.361631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53710 (local address 127.26.189.190:37169)
0806 02:18:20.362114 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:20.362136 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:20.362174 (+ 38us) server_negotiation.cc:407] Connection header received
0806 02:18:20.362853 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:20.362870 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:20.363190 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:20.363469 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:20.364383 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:20.365410 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:20.366626 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:20.367098 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:20.367223 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:20.370317 (+ 3094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:20.370322 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:20.370336 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:18:20.370367 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:20.372345 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:20.372849 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:20.372856 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:20.372863 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:20.373008 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:20.373305 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:20.373307 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:20.373309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:20.373794 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:20.373957 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:20.374273 (+ 316us) server_negotiation.cc:299] Negotiation successful
0806 02:18:20.374609 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":156,"threads_started":1}
I20260806 02:18:20.377976 9424 raft_consensus.cc:348] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061c8180efce4f8597e4db20346e269a" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37169 } }
I20260806 02:18:20.378199 9424 raft_consensus.cc:374] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:18:20.378235 9424 raft_consensus.cc:729] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 061c8180efce4f8597e4db20346e269a, State: Initialized, Role: FOLLOWER
I20260806 02:18:20.378664 9424 consensus_queue.cc:260] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061c8180efce4f8597e4db20346e269a" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37169 } }
I20260806 02:18:20.378788 9424 raft_consensus.cc:388] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:18:20.378872 9424 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:18:20.378963 9424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:18:20.379863 9424 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061c8180efce4f8597e4db20346e269a" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37169 } }
I20260806 02:18:20.380199 9424 leader_election.cc:302] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 061c8180efce4f8597e4db20346e269a; no voters:
I20260806 02:18:20.380528 9424 leader_election.cc:288] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:18:20.380685 9431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:18:20.380991 9431 raft_consensus.cc:686] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [term 1 LEADER]: Becoming Leader. State: Replica: 061c8180efce4f8597e4db20346e269a, State: Running, Role: LEADER
I20260806 02:18:20.381313 9431 consensus_queue.cc:237] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061c8180efce4f8597e4db20346e269a" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37169 } }
I20260806 02:18:20.381893 9424 sys_catalog.cc:564] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:18:20.383211 9432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "061c8180efce4f8597e4db20346e269a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061c8180efce4f8597e4db20346e269a" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37169 } } }
I20260806 02:18:20.383263 9434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 061c8180efce4f8597e4db20346e269a. Latest consensus state: current_term: 1 leader_uuid: "061c8180efce4f8597e4db20346e269a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061c8180efce4f8597e4db20346e269a" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37169 } } }
I20260806 02:18:20.383337 9432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [sys.catalog]: This master's current role is: LEADER
I20260806 02:18:20.383369 9434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a [sys.catalog]: This master's current role is: LEADER
I20260806 02:18:20.383710 9441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:18:20.386773 9441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:18:20.392948 9441 catalog_manager.cc:1347] Generated new cluster ID: 51cb5536d5f74335abfbfed9c5246163
I20260806 02:18:20.393021 9441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:18:20.406536 9441 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:18:20.407799 9441 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:18:20.415199 9441 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a: Generated new TSK 0
I20260806 02:18:20.416043 9441 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:18:20.454949 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37169
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:34921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:18:20.572294 9454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:20.572553 9454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:20.572649 9454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:20.577083 9454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:20.577159 9454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:20.577272 9454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:18:20.582794 9454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:20.583936 9454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:20.584998 9454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:20.595276 9462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:20.595299 9461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:20.595289 9464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:20.595511 9454 server_base.cc:1034] running on GCE node
I20260806 02:18:20.595986 9454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:20.596745 9454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:20.597925 9454 hybrid_clock.cc:648] HybridClock initialized: now 1785982700597902 us; error 37 us; skew 500 ppm
Aug 06 02:18:20 dist-test-slave-gkw7 krb5kdc[9312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982700, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:18:20.604837 9454 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:18:20.605855 9454 webserver.cc:460] Webserver started at http://127.26.189.129:33695/ using document root <none> and password file <none>
I20260806 02:18:20.606444 9454 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:20.606539 9454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:20.606788 9454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:20.608898 9454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "6917db5079a445b5ab51fd93b107d061"
format_stamp: "Formatted at 2026-08-06 02:18:20 on dist-test-slave-gkw7"
server_key: "fe5c9a14a1a76e394ebed2eff0b2c805"
server_key_iv: "33648a2961c2d03289f59c81374cf64e"
server_key_version: "encryptionkey@0"
I20260806 02:18:20.609483 9454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "6917db5079a445b5ab51fd93b107d061"
format_stamp: "Formatted at 2026-08-06 02:18:20 on dist-test-slave-gkw7"
server_key: "fe5c9a14a1a76e394ebed2eff0b2c805"
server_key_iv: "33648a2961c2d03289f59c81374cf64e"
server_key_version: "encryptionkey@0"
I20260806 02:18:20.613191 9454 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:18:20.615688 9475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:20.616909 9454 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 02:18:20.617048 9454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "6917db5079a445b5ab51fd93b107d061"
format_stamp: "Formatted at 2026-08-06 02:18:20 on dist-test-slave-gkw7"
server_key: "fe5c9a14a1a76e394ebed2eff0b2c805"
server_key_iv: "33648a2961c2d03289f59c81374cf64e"
server_key_version: "encryptionkey@0"
I20260806 02:18:20.617165 9454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:20.626902 9454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:20.629961 9454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:20.630164 9454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:20.630762 9454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:20.631587 9454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:20.631667 9454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:20.631762 9454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:20.631812 9454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:20.641000 9454 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:38267
I20260806 02:18:20.641026 9624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:38267 every 8 connection(s)
I20260806 02:18:20.641993 9454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:18:20.642798 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 9454
I20260806 02:18:20.642921 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:18:20.643298 27382 external_mini_cluster.cc:1428] Setting key d476b03e8b8d44136494f8c5da98e22f
Aug 06 02:18:20 dist-test-slave-gkw7 krb5kdc[9312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982700, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:18:20.658701 9428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:20.644000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:52257 (local address 127.26.189.190:37169)
0806 02:18:20.644160 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:20.644165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:20.645206 (+ 1041us) server_negotiation.cc:407] Connection header received
0806 02:18:20.647363 (+ 2157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:20.647369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:20.647436 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:20.647532 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:20.648709 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:20.649286 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:20.651196 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:20.651450 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:20.651552 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:20.654612 (+ 3060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:20.654615 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:20.654617 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:18:20.654643 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:20.656139 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:20.656710 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:20.656713 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:20.656714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:20.656821 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:20.657245 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:20.657279 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:20.657280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:20.657477 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:20.657642 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:20.658267 (+ 625us) server_negotiation.cc:299] Negotiation successful
0806 02:18:20.658427 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 02:18:20.659394 9627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:20.644476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37169 (local address 127.26.189.129:52257)
0806 02:18:20.645036 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:20.645094 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:20.647084 (+ 1990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:20.647680 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:20.647687 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:20.648058 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:20.648545 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:20.648557 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:20.649430 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:20.649437 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:20.651050 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:20.651063 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:20.651641 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:20.651648 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:20.651901 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:20.652595 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:20.652616 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:20.654431 (+ 1815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:18:20.656281 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:18:20.656292 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:18:20.656308 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:18:20.656573 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:18:20.656980 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:18:20.656983 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:18:20.656986 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:18:20.657136 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:18:20.657670 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:18:20.657680 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:18:20.657995 (+ 315us) client_negotiation.cc:769] Sending connection context
0806 02:18:20.658191 (+ 196us) client_negotiation.cc:240] Negotiation successful
0806 02:18:20.658469 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":137,"threads_started":1}
I20260806 02:18:20.660799 9625 heartbeater.cc:347] Connected to a master server at 127.26.189.190:37169
I20260806 02:18:20.661057 9625 heartbeater.cc:464] Registering TS with master...
I20260806 02:18:20.661621 9625 heartbeater.cc:511] Master 127.26.189.190:37169 requested a full tablet report, sending...
I20260806 02:18:20.663471 9369 ts_manager.cc:194] Registered new tserver with Master: 6917db5079a445b5ab51fd93b107d061 (127.26.189.129:38267)
I20260806 02:18:20.665232 9369 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:52257
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:18:20.676503 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37169
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:34921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:18:20.790943 9632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:20.791230 9632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:20.791322 9632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:20.795315 9632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:20.795393 9632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:20.795475 9632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:18:20.800776 9632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:20.801950 9632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:20.803005 9632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:20.812894 9643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:20.812968 9640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:20.812882 9641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:20.813256 9632 server_base.cc:1034] running on GCE node
I20260806 02:18:20.813724 9632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:20.814316 9632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:20.815483 9632 hybrid_clock.cc:648] HybridClock initialized: now 1785982700815468 us; error 26 us; skew 500 ppm
Aug 06 02:18:20 dist-test-slave-gkw7 krb5kdc[9312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982700, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:18:20.818325 9632 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:18:20.819262 9632 webserver.cc:460] Webserver started at http://127.26.189.130:46871/ using document root <none> and password file <none>
I20260806 02:18:20.819852 9632 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:20.819947 9632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:20.820204 9632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:20.822549 9632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "67987eb229c546a5b71d7aae1a59a251"
format_stamp: "Formatted at 2026-08-06 02:18:20 on dist-test-slave-gkw7"
server_key: "57eefd3fb1eb6b78b65f77bfda7b7864"
server_key_iv: "0bdee617ef7349d53b99c9f729dc33e7"
server_key_version: "encryptionkey@0"
I20260806 02:18:20.823153 9632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "67987eb229c546a5b71d7aae1a59a251"
format_stamp: "Formatted at 2026-08-06 02:18:20 on dist-test-slave-gkw7"
server_key: "57eefd3fb1eb6b78b65f77bfda7b7864"
server_key_iv: "0bdee617ef7349d53b99c9f729dc33e7"
server_key_version: "encryptionkey@0"
I20260806 02:18:20.827682 9632 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 02:18:20.830346 9656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:20.831573 9632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:18:20.831724 9632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "67987eb229c546a5b71d7aae1a59a251"
format_stamp: "Formatted at 2026-08-06 02:18:20 on dist-test-slave-gkw7"
server_key: "57eefd3fb1eb6b78b65f77bfda7b7864"
server_key_iv: "0bdee617ef7349d53b99c9f729dc33e7"
server_key_version: "encryptionkey@0"
I20260806 02:18:20.831842 9632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:20.841940 9632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:20.844750 9632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:20.844956 9632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:20.845592 9632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:20.846423 9632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:20.846498 9632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:20.846570 9632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:20.846614 9632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:20.856004 9632 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:33545
I20260806 02:18:20.856036 9808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:33545 every 8 connection(s)
I20260806 02:18:20.856920 9632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:18:20.863786 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 9632
I20260806 02:18:20.863926 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:18:20.864255 27382 external_mini_cluster.cc:1428] Setting key 7dc4d7159bc141529c755d95f051524e
Aug 06 02:18:20 dist-test-slave-gkw7 krb5kdc[9312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982700, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:18:20.871448 9428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:20.858724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:49435 (local address 127.26.189.190:37169)
0806 02:18:20.858867 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:20.858871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:20.859673 (+ 802us) server_negotiation.cc:407] Connection header received
0806 02:18:20.861075 (+ 1402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:20.861078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:20.861142 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:20.861234 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:20.862520 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:20.863068 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:20.864371 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:20.864630 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:20.864751 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:20.867427 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:20.867431 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:20.867434 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:18:20.867467 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:20.869174 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:20.869786 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:20.869790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:20.869791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:20.869886 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:20.870257 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:20.870261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:20.870263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:20.870463 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:20.870575 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:20.871149 (+ 574us) server_negotiation.cc:299] Negotiation successful
0806 02:18:20.871280 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 02:18:20.872283 9811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:20.859035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37169 (local address 127.26.189.130:49435)
0806 02:18:20.859509 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:20.859552 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:20.860860 (+ 1308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:20.861423 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:20.861430 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:20.861862 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:20.862345 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:20.862358 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:20.863207 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:20.863216 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:20.864244 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:20.864254 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:20.864827 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:20.864832 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:20.865049 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:20.865793 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:20.865809 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:20.867259 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:18:20.869298 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:18:20.869303 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:18:20.869315 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:18:20.869660 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:18:20.869987 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:18:20.869990 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:18:20.869992 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:18:20.870150 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:18:20.870574 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:18:20.870581 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:18:20.870900 (+ 319us) client_negotiation.cc:769] Sending connection context
0806 02:18:20.871087 (+ 187us) client_negotiation.cc:240] Negotiation successful
0806 02:18:20.871435 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":125,"threads_started":1}
I20260806 02:18:20.873642 9809 heartbeater.cc:347] Connected to a master server at 127.26.189.190:37169
I20260806 02:18:20.873894 9809 heartbeater.cc:464] Registering TS with master...
I20260806 02:18:20.874390 9809 heartbeater.cc:511] Master 127.26.189.190:37169 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
I20260806 02:18:20.875440 9369 ts_manager.cc:194] Registered new tserver with Master: 67987eb229c546a5b71d7aae1a59a251 (127.26.189.130:33545)
I20260806 02:18:20.875976 9369 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:49435
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:18:20.896042 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37169
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:34921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:18:21.010953 9814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:18:21.011209 9814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:18:21.011255 9814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:18:21.015502 9814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:18:21.015570 9814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:18:21.015631 9814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:18:21.021044 9814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:18:21.022286 9814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:18:21.023365 9814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:18:21.033154 9822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:21.033159 9820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:18:21.033159 9819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:18:21.033519 9814 server_base.cc:1034] running on GCE node
I20260806 02:18:21.033931 9814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:18:21.034538 9814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:18:21.035701 9814 hybrid_clock.cc:648] HybridClock initialized: now 1785982701035684 us; error 28 us; skew 500 ppm
Aug 06 02:18:21 dist-test-slave-gkw7 krb5kdc[9312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982701, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:18:21.038618 9814 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:18:21.039522 9814 webserver.cc:460] Webserver started at http://127.26.189.131:36895/ using document root <none> and password file <none>
I20260806 02:18:21.040089 9814 fs_manager.cc:359] Metadata directory not provided
I20260806 02:18:21.040160 9814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:18:21.040410 9814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:18:21.042522 9814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "b5598a678dc3450ea9372d0007c175ae"
format_stamp: "Formatted at 2026-08-06 02:18:21 on dist-test-slave-gkw7"
server_key: "02163003eac7b1e6d7b386eab86e990e"
server_key_iv: "5c1265baedda1134b074caa1bcb18139"
server_key_version: "encryptionkey@0"
I20260806 02:18:21.043164 9814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "b5598a678dc3450ea9372d0007c175ae"
format_stamp: "Formatted at 2026-08-06 02:18:21 on dist-test-slave-gkw7"
server_key: "02163003eac7b1e6d7b386eab86e990e"
server_key_iv: "5c1265baedda1134b074caa1bcb18139"
server_key_version: "encryptionkey@0"
I20260806 02:18:21.046919 9814 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:18:21.049338 9830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:21.050611 9814 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:18:21.050745 9814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "b5598a678dc3450ea9372d0007c175ae"
format_stamp: "Formatted at 2026-08-06 02:18:21 on dist-test-slave-gkw7"
server_key: "02163003eac7b1e6d7b386eab86e990e"
server_key_iv: "5c1265baedda1134b074caa1bcb18139"
server_key_version: "encryptionkey@0"
I20260806 02:18:21.050854 9814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:18:21.088155 9814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:18:21.091511 9814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:18:21.091686 9814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:18:21.092247 9814 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:18:21.093046 9814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:18:21.093093 9814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:21.093142 9814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:18:21.093159 9814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:18:21.102540 9814 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:44573
I20260806 02:18:21.102562 9985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:44573 every 8 connection(s)
I20260806 02:18:21.103492 9814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:18:21.103840 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 9814
I20260806 02:18:21.103986 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:18:21.104375 27382 external_mini_cluster.cc:1428] Setting key 283c1a29c0ed9bccfd99acc09244b324
Aug 06 02:18:21 dist-test-slave-gkw7 krb5kdc[9312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982701, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:18:21.118011 9428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.105593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:50181 (local address 127.26.189.190:37169)
0806 02:18:21.105724 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:21.105729 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:21.106763 (+ 1034us) server_negotiation.cc:407] Connection header received
0806 02:18:21.108376 (+ 1613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:21.108378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:21.108424 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:21.108493 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:21.109720 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.110274 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.111475 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.111708 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.111831 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.114349 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:21.114352 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:21.114354 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:18:21.114379 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:21.115759 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:21.116308 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:21.116311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:21.116312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:21.116392 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:21.116754 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:21.116761 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:21.116763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:21.116947 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:21.117060 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:21.117691 (+ 631us) server_negotiation.cc:299] Negotiation successful
0806 02:18:21.117834 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 02:18:21.119061 9989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.106093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37169 (local address 127.26.189.131:50181)
0806 02:18:21.106608 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:21.106668 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:21.108166 (+ 1498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:21.108626 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:21.108633 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:21.109003 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:18:21.109504 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:21.109518 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.110412 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.110416 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:21.111332 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:21.111342 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.111879 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.111883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:21.112067 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.112628 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:18:21.112644 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:18:21.114156 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:18:21.115889 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:18:21.115894 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:18:21.115910 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:18:21.116181 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:18:21.116489 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:18:21.116492 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:18:21.116494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:18:21.116639 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:18:21.117060 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:18:21.117068 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:18:21.117370 (+ 302us) client_negotiation.cc:769] Sending connection context
0806 02:18:21.117633 (+ 263us) client_negotiation.cc:240] Negotiation successful
0806 02:18:21.117987 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":113,"threads_started":1}
I20260806 02:18:21.120132 9986 heartbeater.cc:347] Connected to a master server at 127.26.189.190:37169
I20260806 02:18:21.120425 9986 heartbeater.cc:464] Registering TS with master...
I20260806 02:18:21.120999 9986 heartbeater.cc:511] Master 127.26.189.190:37169 requested a full tablet report, sending...
I20260806 02:18:21.122140 9369 ts_manager.cc:194] Registered new tserver with Master: b5598a678dc3450ea9372d0007c175ae (127.26.189.131:44573)
I20260806 02:18:21.122767 9369 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:50181
I20260806 02:18:21.130975 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:18:21.140564 9428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.132924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53726 (local address 127.26.189.190:37169)
0806 02:18:21.133089 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:21.133097 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:21.133239 (+ 142us) server_negotiation.cc:407] Connection header received
0806 02:18:21.133339 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:21.133342 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:21.133382 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:21.133449 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:18:21.134195 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.134721 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.135663 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.135881 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.135963 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.137418 (+ 1455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:18:21.137421 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:18:21.137423 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:18:21.137446 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:18:21.138740 (+ 1294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:21.139240 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:21.139243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:21.139244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:21.139329 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:18:21.139602 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:18:21.139605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:18:21.139606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:18:21.139839 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:18:21.139952 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:21.140263 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 02:18:21.140362 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 02:18:21.143884 9369 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53726:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:18:21.147480 9369 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:18:21.163041 10000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.156793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38267 (local address 127.0.0.1:44724)
0806 02:18:21.157608 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:21.157653 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:21.157812 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:21.158651 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:21.158660 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:21.158700 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:18:21.158816 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:21.158821 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.159938 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.159944 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:21.161510 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:21.161521 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.162466 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.162470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:21.162588 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.162627 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 02:18:21.162742 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 02:18:21.162867 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"mutex_wait_us":49,"spinlock_wait_cycles":4352,"thread_start_us":114,"threads_started":1}
I20260806 02:18:21.163223 10001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.156776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56930 (local address 127.26.189.130:33545)
0806 02:18:21.157435 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:21.157449 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:21.157756 (+ 307us) server_negotiation.cc:407] Connection header received
0806 02:18:21.158031 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:21.158037 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:21.158253 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:21.158388 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:18:21.158969 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.160154 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.161766 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.162604 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.162734 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.162858 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:21.162947 (+ 89us) server_negotiation.cc:299] Negotiation successful
0806 02:18:21.163044 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":120,"threads_started":1}
I20260806 02:18:21.163523 10003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.156952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44724 (local address 127.26.189.129:38267)
0806 02:18:21.157514 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:21.157562 (+ 48us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:21.157969 (+ 407us) server_negotiation.cc:407] Connection header received
0806 02:18:21.158057 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:21.158062 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:21.158292 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:21.158453 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:18:21.158953 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.159798 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.161693 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.162335 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.162480 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.162623 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:21.163278 (+ 655us) server_negotiation.cc:299] Negotiation successful
0806 02:18:21.163390 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":68,"threads_started":1}
I20260806 02:18:21.163089 10002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.156613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:33545 (local address 127.0.0.1:56930)
0806 02:18:21.157589 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:21.157654 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:21.157836 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:21.158652 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:21.158657 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:21.158692 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:18:21.158825 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:21.158833 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.160311 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.160317 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:21.161645 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:21.161655 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.162723 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.162728 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:21.162827 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.162848 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 02:18:21.162917 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 02:18:21.162974 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"mutex_wait_us":77,"spinlock_wait_cycles":1792,"thread_start_us":99,"threads_started":1}
I20260806 02:18:21.163362 10004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.157451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:44573 (local address 127.0.0.1:44878)
0806 02:18:21.158473 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:21.158486 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:21.158582 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:21.158975 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:21.158978 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:21.158995 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:18:21.159069 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:21.159074 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.160399 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.160402 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:21.161729 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:21.161740 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.162929 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.162933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:21.163029 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.163053 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 02:18:21.163124 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 02:18:21.163203 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":961,"mutex_wait_us":44,"thread_start_us":114,"threads_started":1}
I20260806 02:18:21.164709 10005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.157803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44878 (local address 127.26.189.131:44573)
0806 02:18:21.158274 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:21.158288 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:21.158589 (+ 301us) server_negotiation.cc:407] Connection header received
0806 02:18:21.158675 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:21.158680 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:21.158851 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:21.158991 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:18:21.159174 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.160261 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.161845 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.162604 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.162735 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.162858 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:21.163459 (+ 601us) server_negotiation.cc:299] Negotiation successful
0806 02:18:21.163565 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":170,"threads_started":1}
I20260806 02:18:21.166630 9539 tablet_service.cc:1467] Processing CreateTablet for tablet 66f40e93032b4ded9b2f8bd8eef5cc13 (DEFAULT_TABLE table=test-table [id=731d087c99ae408cbf83561763bfd306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:18:21.166733 9715 tablet_service.cc:1467] Processing CreateTablet for tablet 66f40e93032b4ded9b2f8bd8eef5cc13 (DEFAULT_TABLE table=test-table [id=731d087c99ae408cbf83561763bfd306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:18:21.167327 9893 tablet_service.cc:1467] Processing CreateTablet for tablet 66f40e93032b4ded9b2f8bd8eef5cc13 (DEFAULT_TABLE table=test-table [id=731d087c99ae408cbf83561763bfd306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:18:21.167724 9539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66f40e93032b4ded9b2f8bd8eef5cc13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:18:21.167857 9715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66f40e93032b4ded9b2f8bd8eef5cc13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:18:21.168263 9893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66f40e93032b4ded9b2f8bd8eef5cc13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:18:21.174084 10006 tablet_bootstrap.cc:492] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061: Bootstrap starting.
I20260806 02:18:21.175782 10007 tablet_bootstrap.cc:492] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae: Bootstrap starting.
I20260806 02:18:21.176616 10006 tablet_bootstrap.cc:654] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061: Neither blocks nor log segments found. Creating new log.
I20260806 02:18:21.177376 10006 log.cc:824] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061: Log is configured to *not* fsync() on all Append() calls
I20260806 02:18:21.177706 10007 tablet_bootstrap.cc:654] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae: Neither blocks nor log segments found. Creating new log.
I20260806 02:18:21.177883 10008 tablet_bootstrap.cc:492] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251: Bootstrap starting.
I20260806 02:18:21.179083 10007 log.cc:824] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae: Log is configured to *not* fsync() on all Append() calls
I20260806 02:18:21.179798 10006 tablet_bootstrap.cc:492] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061: No bootstrap required, opened a new log
I20260806 02:18:21.180002 10006 ts_tablet_manager.cc:1397] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:18:21.180473 10008 tablet_bootstrap.cc:654] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251: Neither blocks nor log segments found. Creating new log.
I20260806 02:18:21.180832 10007 tablet_bootstrap.cc:492] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae: No bootstrap required, opened a new log
I20260806 02:18:21.180976 10007 ts_tablet_manager.cc:1397] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260806 02:18:21.181286 10008 log.cc:824] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251: Log is configured to *not* fsync() on all Append() calls
I20260806 02:18:21.183471 10008 tablet_bootstrap.cc:492] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251: No bootstrap required, opened a new log
I20260806 02:18:21.183724 10008 ts_tablet_manager.cc:1397] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:18:21.184494 10007 raft_consensus.cc:348] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67987eb229c546a5b71d7aae1a59a251" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33545 } } peers { permanent_uuid: "6917db5079a445b5ab51fd93b107d061" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38267 } } peers { permanent_uuid: "b5598a678dc3450ea9372d0007c175ae" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44573 } }
I20260806 02:18:21.184751 10007 raft_consensus.cc:374] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:18:21.184826 10007 raft_consensus.cc:729] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5598a678dc3450ea9372d0007c175ae, State: Initialized, Role: FOLLOWER
I20260806 02:18:21.184682 10006 raft_consensus.cc:348] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67987eb229c546a5b71d7aae1a59a251" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33545 } } peers { permanent_uuid: "6917db5079a445b5ab51fd93b107d061" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38267 } } peers { permanent_uuid: "b5598a678dc3450ea9372d0007c175ae" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44573 } }
I20260806 02:18:21.184957 10006 raft_consensus.cc:374] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:18:21.185065 10006 raft_consensus.cc:729] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6917db5079a445b5ab51fd93b107d061, State: Initialized, Role: FOLLOWER
I20260806 02:18:21.185333 10007 consensus_queue.cc:260] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67987eb229c546a5b71d7aae1a59a251" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33545 } } peers { permanent_uuid: "6917db5079a445b5ab51fd93b107d061" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38267 } } peers { permanent_uuid: "b5598a678dc3450ea9372d0007c175ae" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44573 } }
I20260806 02:18:21.185707 10006 consensus_queue.cc:260] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67987eb229c546a5b71d7aae1a59a251" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33545 } } peers { permanent_uuid: "6917db5079a445b5ab51fd93b107d061" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38267 } } peers { permanent_uuid: "b5598a678dc3450ea9372d0007c175ae" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44573 } }
I20260806 02:18:21.186486 10007 ts_tablet_manager.cc:1428] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 02:18:21.186542 9986 heartbeater.cc:503] Master 127.26.189.190:37169 was elected leader, sending a full tablet report...
I20260806 02:18:21.186748 10006 ts_tablet_manager.cc:1428] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061: Time spent starting tablet: real 0.007s user 0.001s sys 0.006s
I20260806 02:18:21.187106 9625 heartbeater.cc:503] Master 127.26.189.190:37169 was elected leader, sending a full tablet report...
I20260806 02:18:21.187773 10008 raft_consensus.cc:348] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67987eb229c546a5b71d7aae1a59a251" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33545 } } peers { permanent_uuid: "6917db5079a445b5ab51fd93b107d061" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38267 } } peers { permanent_uuid: "b5598a678dc3450ea9372d0007c175ae" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44573 } }
I20260806 02:18:21.188078 10008 raft_consensus.cc:374] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:18:21.188174 10008 raft_consensus.cc:729] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67987eb229c546a5b71d7aae1a59a251, State: Initialized, Role: FOLLOWER
I20260806 02:18:21.188601 10008 consensus_queue.cc:260] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67987eb229c546a5b71d7aae1a59a251" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33545 } } peers { permanent_uuid: "6917db5079a445b5ab51fd93b107d061" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38267 } } peers { permanent_uuid: "b5598a678dc3450ea9372d0007c175ae" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44573 } }
I20260806 02:18:21.189342 9809 heartbeater.cc:503] Master 127.26.189.190:37169 was elected leader, sending a full tablet report...
I20260806 02:18:21.189601 10008 ts_tablet_manager.cc:1428] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:18:21.219938 10015 raft_consensus.cc:482] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:18:21.220207 10015 raft_consensus.cc:504] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67987eb229c546a5b71d7aae1a59a251" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33545 } } peers { permanent_uuid: "6917db5079a445b5ab51fd93b107d061" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38267 } } peers { permanent_uuid: "b5598a678dc3450ea9372d0007c175ae" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44573 } }
I20260806 02:18:21.221510 10015 leader_election.cc:288] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6917db5079a445b5ab51fd93b107d061 (127.26.189.129:38267), b5598a678dc3450ea9372d0007c175ae (127.26.189.131:44573)
I20260806 02:18:21.226521 10003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.221957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:34221 (local address 127.26.189.129:38267)
0806 02:18:21.222125 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:21.222131 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:21.222147 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:18:21.222209 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:21.222213 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:21.222269 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:21.222371 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:18:21.222792 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.223593 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.225174 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.225825 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.225955 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.226008 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:21.226312 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 02:18:21.226385 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 02:18:21.226521 10005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.222315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:57943 (local address 127.26.189.131:44573)
0806 02:18:21.222436 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:21.222441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:21.222649 (+ 208us) server_negotiation.cc:407] Connection header received
0806 02:18:21.222756 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:21.222759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:21.222811 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:21.222893 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:18:21.223133 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.223815 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.225174 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.225825 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.225955 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.226008 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:21.226312 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 02:18:21.226385 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 02:18:21.226599 9811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.221841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38267 (local address 127.26.189.130:34221)
0806 02:18:21.221974 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:21.221992 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:21.222092 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:21.222498 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:21.222501 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:21.222520 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:18:21.222669 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:21.222678 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.223704 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.223706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:21.225015 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:21.225028 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.225955 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.225959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:21.226124 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.226193 (+ 69us) client_negotiation.cc:769] Sending connection context
0806 02:18:21.226277 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 02:18:21.226434 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":159}
I20260806 02:18:21.226609 10020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.222158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:44573 (local address 127.26.189.130:57943)
0806 02:18:21.222543 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:21.222556 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:18:21.222654 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:18:21.222913 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:18:21.222915 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:18:21.222930 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:18:21.223021 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:21.223025 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.223911 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.223914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:21.225050 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:18:21.225059 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.225955 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.225959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:18:21.226164 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.226204 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 02:18:21.226277 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 02:18:21.226431 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":79,"thread_start_us":152,"threads_started":1}
I20260806 02:18:21.227358 9920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66f40e93032b4ded9b2f8bd8eef5cc13" candidate_uuid: "67987eb229c546a5b71d7aae1a59a251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5598a678dc3450ea9372d0007c175ae" is_pre_election: true
I20260806 02:18:21.227635 9920 raft_consensus.cc:2454] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67987eb229c546a5b71d7aae1a59a251 in term 0.
I20260806 02:18:21.227855 9570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66f40e93032b4ded9b2f8bd8eef5cc13" candidate_uuid: "67987eb229c546a5b71d7aae1a59a251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6917db5079a445b5ab51fd93b107d061" is_pre_election: true
I20260806 02:18:21.228144 9570 raft_consensus.cc:2454] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67987eb229c546a5b71d7aae1a59a251 in term 0.
I20260806 02:18:21.228147 9661 leader_election.cc:302] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67987eb229c546a5b71d7aae1a59a251, b5598a678dc3450ea9372d0007c175ae; no voters:
I20260806 02:18:21.228475 10015 raft_consensus.cc:2781] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:18:21.228605 10015 raft_consensus.cc:482] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:18:21.228677 10015 raft_consensus.cc:3037] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:18:21.229806 10015 raft_consensus.cc:504] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67987eb229c546a5b71d7aae1a59a251" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33545 } } peers { permanent_uuid: "6917db5079a445b5ab51fd93b107d061" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38267 } } peers { permanent_uuid: "b5598a678dc3450ea9372d0007c175ae" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44573 } }
I20260806 02:18:21.230155 10015 leader_election.cc:288] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [CANDIDATE]: Term 1 election: Requested vote from peers 6917db5079a445b5ab51fd93b107d061 (127.26.189.129:38267), b5598a678dc3450ea9372d0007c175ae (127.26.189.131:44573)
I20260806 02:18:21.230546 9570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66f40e93032b4ded9b2f8bd8eef5cc13" candidate_uuid: "67987eb229c546a5b71d7aae1a59a251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6917db5079a445b5ab51fd93b107d061"
I20260806 02:18:21.230641 9920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66f40e93032b4ded9b2f8bd8eef5cc13" candidate_uuid: "67987eb229c546a5b71d7aae1a59a251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5598a678dc3450ea9372d0007c175ae"
I20260806 02:18:21.230686 9570 raft_consensus.cc:3037] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:18:21.230819 9920 raft_consensus.cc:3037] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:18:21.231904 9570 raft_consensus.cc:2454] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67987eb229c546a5b71d7aae1a59a251 in term 1.
I20260806 02:18:21.232080 9920 raft_consensus.cc:2454] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67987eb229c546a5b71d7aae1a59a251 in term 1.
I20260806 02:18:21.232200 9661 leader_election.cc:302] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67987eb229c546a5b71d7aae1a59a251, 6917db5079a445b5ab51fd93b107d061; no voters:
I20260806 02:18:21.232388 10015 raft_consensus.cc:2781] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:18:21.232667 10015 raft_consensus.cc:686] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 1 LEADER]: Becoming Leader. State: Replica: 67987eb229c546a5b71d7aae1a59a251, State: Running, Role: LEADER
I20260806 02:18:21.233021 10015 consensus_queue.cc:237] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67987eb229c546a5b71d7aae1a59a251" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33545 } } peers { permanent_uuid: "6917db5079a445b5ab51fd93b107d061" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38267 } } peers { permanent_uuid: "b5598a678dc3450ea9372d0007c175ae" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44573 } }
I20260806 02:18:21.236533 9369 catalog_manager.cc:5495] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67987eb229c546a5b71d7aae1a59a251 (127.26.189.130). New cstate: current_term: 1 leader_uuid: "67987eb229c546a5b71d7aae1a59a251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67987eb229c546a5b71d7aae1a59a251" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6917db5079a445b5ab51fd93b107d061" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5598a678dc3450ea9372d0007c175ae" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44573 } health_report { overall_health: UNKNOWN } } }
I20260806 02:18:21.261817 10001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.258533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56942 (local address 127.26.189.130:33545)
0806 02:18:21.258671 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 02:18:21.258675 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:18:21.258705 (+ 30us) server_negotiation.cc:407] Connection header received
0806 02:18:21.258784 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:18:21.258786 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:18:21.258846 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:18:21.258930 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:18:21.259171 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.259662 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.260490 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:18:21.260704 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:18:21.260781 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:18:21.261042 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:18:21.261463 (+ 421us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:18:21.261615 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 02:18:21.261644 (+ 29us) server_negotiation.cc:299] Negotiation successful
0806 02:18:21.261694 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 02:18:21.267937 9570 raft_consensus.cc:1261] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 6917db5079a445b5ab51fd93b107d061 [term 1 FOLLOWER]: Refusing update from remote peer 67987eb229c546a5b71d7aae1a59a251: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:18:21.267958 9920 raft_consensus.cc:1261] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae [term 1 FOLLOWER]: Refusing update from remote peer 67987eb229c546a5b71d7aae1a59a251: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:18:21.268679 10023 consensus_queue.cc:1035] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6917db5079a445b5ab51fd93b107d061" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:18:21.268934 10015 consensus_queue.cc:1035] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5598a678dc3450ea9372d0007c175ae" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:18:21.278442 10028 mvcc.cc:205] Tried to move back new op lower bound from 7315385144386093056 to 7315385144253984768. Current Snapshot: MvccSnapshot[applied={T|T < 7315385144386093056}]
I20260806 02:18:21.278362 10026 mvcc.cc:205] Tried to move back new op lower bound from 7315385144386093056 to 7315385144253984768. Current Snapshot: MvccSnapshot[applied={T|T < 7315385144386093056}]
I20260806 02:18:21.280453 10027 mvcc.cc:205] Tried to move back new op lower bound from 7315385144386093056 to 7315385144253984768. Current Snapshot: MvccSnapshot[applied={T|T < 7315385144386093056}]
I20260806 02:18:21.288137 9369 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:18:21.288322 9369 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:18:21.290843 9369 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 061c8180efce4f8597e4db20346e269a: Sending DeleteTablet for 3 replicas of tablet 66f40e93032b4ded9b2f8bd8eef5cc13
I20260806 02:18:21.291631 9715 tablet_service.cc:1514] Processing DeleteTablet for tablet 66f40e93032b4ded9b2f8bd8eef5cc13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:18:21 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:56930
I20260806 02:18:21.291926 9539 tablet_service.cc:1514] Processing DeleteTablet for tablet 66f40e93032b4ded9b2f8bd8eef5cc13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:18:21 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:44724
I20260806 02:18:21.292279 10039 tablet_replica.cc:330] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251: stopping tablet replica
I20260806 02:18:21.292207 9893 tablet_service.cc:1514] Processing DeleteTablet for tablet 66f40e93032b4ded9b2f8bd8eef5cc13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:18:21 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:44878
I20260806 02:18:21.292681 10039 raft_consensus.cc:2229] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:18:21.292780 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 9454
I20260806 02:18:21.300644 10039 raft_consensus.cc:2258] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:18:21.301586 10042 tablet_replica.cc:330] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae: stopping tablet replica
I20260806 02:18:21.302098 10042 raft_consensus.cc:2229] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:18:21.302531 10042 raft_consensus.cc:2258] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:18:21.303062 10039 ts_tablet_manager.cc:1905] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:18:21.305648 10039 ts_tablet_manager.cc:1918] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:18:21.305825 10039 log.cc:1196] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/66f40e93032b4ded9b2f8bd8eef5cc13
I20260806 02:18:21.306192 10039 ts_tablet_manager.cc:1939] T 66f40e93032b4ded9b2f8bd8eef5cc13 P 67987eb229c546a5b71d7aae1a59a251: Deleting consensus metadata
I20260806 02:18:21.307372 9350 catalog_manager.cc:4841] TS 67987eb229c546a5b71d7aae1a59a251 (127.26.189.130:33545): tablet 66f40e93032b4ded9b2f8bd8eef5cc13 (table test-table [id=731d087c99ae408cbf83561763bfd306]) successfully deleted
W20260806 02:18:21.309478 9354 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:38267 (error 108)
I20260806 02:18:21.310397 10042 ts_tablet_manager.cc:1905] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:18:21.310439 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 9632
I20260806 02:18:21.313669 10042 ts_tablet_manager.cc:1918] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:18:21.313853 10042 log.cc:1196] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/66f40e93032b4ded9b2f8bd8eef5cc13
I20260806 02:18:21.314324 10042 ts_tablet_manager.cc:1939] T 66f40e93032b4ded9b2f8bd8eef5cc13 P b5598a678dc3450ea9372d0007c175ae: Deleting consensus metadata
I20260806 02:18:21.316303 9354 catalog_manager.cc:4841] TS b5598a678dc3450ea9372d0007c175ae (127.26.189.131:44573): tablet 66f40e93032b4ded9b2f8bd8eef5cc13 (table test-table [id=731d087c99ae408cbf83561763bfd306]) successfully deleted
I20260806 02:18:21.316462 10004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:18:21.316124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38267 (local address 127.0.0.1:44734)
0806 02:18:21.316283 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 02:18:21.316351 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:38267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260806 02:18:21.316648 9354 catalog_manager.cc:4584] TS 6917db5079a445b5ab51fd93b107d061 (127.26.189.129:38267): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 66f40e93032b4ded9b2f8bd8eef5cc13: Network error: Client connection negotiation failed: client connection to 127.26.189.129:38267: connect: Connection refused (error 111)
I20260806 02:18:21.321974 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 9814
I20260806 02:18:21.333213 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 9329
2026-08-06T02:18:21Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2562 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:18:21 dist-test-slave-gkw7 krb5kdc[10046](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:18:21 dist-test-slave-gkw7 krb5kdc[10046](info): set up 2 sockets
Aug 06 02:18:21 dist-test-slave-gkw7 krb5kdc[10046](info): commencing operation
krb5kdc: starting...
W20260806 02:18:22.665184 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:18:22 dist-test-slave-gkw7 krb5kdc[10046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:18:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:18:22Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.189.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.189.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/rangeradmin_127.26.189.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/rangeradmin_127.26.189.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.189.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.189.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/rangerlookup_127.26.189.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/rangerlookup_127.26.189.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.189.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.189.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/HTTP_127.26.189.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/HTTP_127.26.189.148@KRBTEST.COM.keytab.
I20260806 02:18:22.854800 27382 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskHiSG4m/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/postgres -l logfile start
2026-08-06 02:18:25.554 UTC [10086] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 02:18:25.554 UTC [10086] LOG: listening on IPv4 address "127.26.189.148", port 57287
2026-08-06 02:18:25.558 UTC [10086] LOG: listening on Unix socket "/tmp/.s.PGSQL.57287"
2026-08-06 02:18:25.581 UTC [10089] LOG: database system was shut down at 2026-08-06 02:18:24 UTC
2026-08-06 02:18:25.585 UTC [10086] LOG: database system is ready to accept connections
I20260806 02:18:26.734604 27382 mini_postgres.cc:96] Postgres bound to 57287
2026-08-06 02:18:26.742 UTC [10103] FATAL: database "slave" does not exist
127.26.189.148:57287 - accepting connections
I20260806 02:18:26.743788 27382 mini_ranger.cc:161] Starting Ranger...
I20260806 02:18:26.760427 27382 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 02:18:27.283243 27382 mini_ranger.cc:87] Created ranger Postgres database
I20260806 02:18:27.283329 27382 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-admin
2026-08-06 02:18:27,678 [I] DB FLAVOR :POSTGRES
2026-08-06 02:18:27,678 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 02:18:27,678 [I] Checking connection..
2026-08-06 02:18:27,678 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 02:18:27,953 [I] Checking connection passed.
2026-08-06 02:18:27,953 [I] --------- Verifying version history table ---------
2026-08-06 02:18:27,954 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 02:18:28,204 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 02:18:28,205 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 02:18:28,482 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 02:18:28,482 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 02:18:28,482 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 02:18:28.742 UTC [10191] WARNING: there is no transaction in progress
2026-08-06 02:18:28,749 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 02:18:28,750 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 02:18:29,016 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 02:18:29,017 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 02:18:29,017 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 02:18:29,287 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 02:18:29,552 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gkw7.c.gcp-upstream.internal','N') ;"
2026-08-06 02:18:29,826 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 02:18:30,096 [I] Table x_portal_user does not exist in database ranger
2026-08-06 02:18:30,096 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 02:18:30,380 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 02:18:30,380 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 02:18:30,633 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 02:18:30,897 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 02:18:30,897 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 02:18:32.093 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.110 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.127 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.142 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.159 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.178 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.241 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.249 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.265 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.276 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.290 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.308 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.321 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.329 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.337 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:32.343 UTC [10336] WARNING: there is no transaction in progress
2026-08-06 02:18:33,009 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 02:18:33,009 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 02:18:33,285 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 02:18:33,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 02:18:33,568 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 02:18:33,568 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 02:18:33,853 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 02:18:33,853 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 02:18:34,097 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 02:18:34,348 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gkw7.c.gcp-upstream.internal';"
2026-08-06 02:18:34,611 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 02:18:34,611 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 02:18:34,863 [I] DB_PATCHES have already been applied
I20260806 02:18:34.869750 27382 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-admin:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskHiSG4m/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 02:18:34.869824 27382 mini_ranger.cc:193] Using host: 127.26.189.148
I20260806 02:18:34.874609 27382 mini_ranger.cc:227] Ranger admin URL: http://127.26.189.148:49195
Aug 06, 2026 2:18:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 2:18:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 2:18:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 2:18:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 2:18:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 2:18:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 2:18:35 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 02:18:36.264057 27382 mini_ranger.cc:160] Time spent starting Ranger: real 9.520s user 0.006s sys 0.006s
Aug 06, 2026 2:18:56 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 2:18:56 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 06, 2026 2:18:56 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 2:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 2:18:56 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 2:18:57 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 02:18:58.512349 27382 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.189.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.189.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/rangerkms_127.26.189.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/rangerkms_127.26.189.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.189.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.189.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.189.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/HTTP_127.26.189.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.189.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/HTTP_127.26.189.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 02:18:58 dist-test-slave-gkw7 krb5kdc[10046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982738, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 02:18:58.605167 27382 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 02:18:58.616132 27382 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 02:18:59.547253 27382 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 02:18:59.547346 27382 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-kms
I20260806 02:18:59.547464 27382 mini_ranger_kms.cc:227] Using postgres at 127.26.189.148:57287
2026-08-06 02:18:59,870 [I] DB FLAVOR :POSTGRES
2026-08-06 02:18:59,870 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 02:18:59,870 [I] Checking connection
2026-08-06 02:18:59,871 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 02:19:00,128 [I] connection success
2026-08-06 02:19:00,128 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 02:19:00,128 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 02:19:00,128 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 02:19:00,406 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 02:19:00,406 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 02:19:00,406 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 02:19:00,406 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:57287/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 02:19:00,690 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 02:19:01.150473 27382 mini_ranger_kms.cc:310] Created kms service
I20260806 02:19:01.368188 27382 mini_ranger_kms.cc:326] Created kudu user
I20260806 02:19:01.417979 27382 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 02:19:01 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982738, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:19:01.881248 27382 mini_ranger_kms.cc:384] Added ranger policy
I20260806 02:19:01.881630 27382 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-kms:/tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 02:19:01.881686 27382 mini_ranger_kms.cc:240] Using host: 127.26.189.148
I20260806 02:19:01.886503 27382 mini_ranger_kms.cc:276] Ranger KMS PID: 10582
I20260806 02:19:01.886655 27382 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.189.148:43007
Aug 06, 2026 2:19:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 2:19:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 2:19:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 2:19:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 2:19:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 2:19:03 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 02:19:04 dist-test-slave-gkw7 krb5kdc[10046](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785982744, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.189.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:19:04.576710 27382 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.972s user 0.015s sys 0.293s
I20260806 02:19:04.576874 27382 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 02:19:04.577008 27382 mini_ranger_kms.cc:401] 127.26.189.148:43007/kms/v1/keys
Aug 06 02:19:04 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982744, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.189.148@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
Aug 06 02:19:05 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982744, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.189.148@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
Aug 06 02:19:07 dist-test-slave-gkw7 krb5kdc[10046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:19:07.453130 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:42517
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:42517
--ranger_config_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.189.148:43007/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:19:07.572695 10650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:19:07.572958 10650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:19:07.572999 10650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:19:07.577086 10650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:19:07.577149 10650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:19:07.577169 10650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:19:07.577185 10650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:19:07.577229 10650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:19:07.582911 10650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.189.148:43007/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:42517
--ranger_config_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:42517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:19:07.583977 10650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:19:07.585033 10650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:19:07.594127 10656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:07.594170 10659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:07.594292 10657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:19:07.594584 10650 server_base.cc:1034] running on GCE node
I20260806 02:19:07.595239 10650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:19:07.596626 10650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:19:07.597816 10650 hybrid_clock.cc:648] HybridClock initialized: now 1785982747597791 us; error 35 us; skew 500 ppm
Aug 06 02:19:07 dist-test-slave-gkw7 krb5kdc[10046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982747, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:19:07.606388 10650 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:19:07.607760 10650 webserver.cc:460] Webserver started at http://127.26.189.190:42115/ using document root <none> and password file <none>
I20260806 02:19:07.608464 10650 fs_manager.cc:359] Metadata directory not provided
I20260806 02:19:07.608528 10650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:19:07.608794 10650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 02:19:07 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982747, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:19:07.670018 10650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "5b331a114e4e4e4c93f01e69971110ac"
format_stamp: "Formatted at 2026-08-06 02:19:07 on dist-test-slave-gkw7"
server_key: "af81e90b4bbc5fe93b1f73e137736c62"
server_key_iv: "56e793cf49e16b7f09692152482b7491"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:07.670725 10650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "5b331a114e4e4e4c93f01e69971110ac"
format_stamp: "Formatted at 2026-08-06 02:19:07 on dist-test-slave-gkw7"
server_key: "af81e90b4bbc5fe93b1f73e137736c62"
server_key_iv: "56e793cf49e16b7f09692152482b7491"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:07.675379 10650 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:19:07.690948 10668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:07.692631 10650 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:19:07.692809 10650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "5b331a114e4e4e4c93f01e69971110ac"
format_stamp: "Formatted at 2026-08-06 02:19:07 on dist-test-slave-gkw7"
server_key: "af81e90b4bbc5fe93b1f73e137736c62"
server_key_iv: "56e793cf49e16b7f09692152482b7491"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:07.692958 10650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:19:07.713774 10650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:19:07.717200 10650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:19:07.717447 10650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:19:07.726452 10650 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:42517
I20260806 02:19:07.726470 10734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:42517 every 8 connection(s)
I20260806 02:19:07.727687 10650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:19:07.731396 10735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:19:07.732214 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 10650
I20260806 02:19:07.732380 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:19:07.732725 27382 external_mini_cluster.cc:1428] Setting key 85abc321619675c3113559cb1d594648
I20260806 02:19:07.739118 10735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac: Bootstrap starting.
I20260806 02:19:07.742084 10735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac: Neither blocks nor log segments found. Creating new log.
Aug 06 02:19:07 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:19:07.743000 10735 log.cc:824] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac: Log is configured to *not* fsync() on all Append() calls
I20260806 02:19:07.745507 10735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac: No bootstrap required, opened a new log
I20260806 02:19:07.748853 10741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:07.734442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38364 (local address 127.26.189.190:42517)
0806 02:19:07.734903 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:07.734930 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:07.734969 (+ 39us) server_negotiation.cc:407] Connection header received
0806 02:19:07.735695 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:07.735712 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:07.736058 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:07.736443 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:19:07.737326 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:07.738490 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:07.739532 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:07.740051 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:07.740253 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:07.743220 (+ 2967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:19:07.743225 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:19:07.743239 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:19:07.743269 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:19:07.745841 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:07.746342 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:07.746354 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:07.746359 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:07.746472 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:07.746791 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:07.746796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:07.746798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:07.747219 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:19:07.747472 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:07.747758 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 02:19:07.748092 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":165,"threads_started":1}
I20260806 02:19:07.749751 10735 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b331a114e4e4e4c93f01e69971110ac" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42517 } }
I20260806 02:19:07.750133 10735 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:19:07.750200 10735 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b331a114e4e4e4c93f01e69971110ac, State: Initialized, Role: FOLLOWER
I20260806 02:19:07.750710 10735 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b331a114e4e4e4c93f01e69971110ac" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42517 } }
I20260806 02:19:07.750871 10735 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:19:07.750957 10735 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:19:07.751060 10735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:19:07.752238 10735 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b331a114e4e4e4c93f01e69971110ac" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42517 } }
I20260806 02:19:07.752625 10735 leader_election.cc:302] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b331a114e4e4e4c93f01e69971110ac; no voters:
I20260806 02:19:07.753026 10735 leader_election.cc:288] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:19:07.753214 10743 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:19:07.753471 10743 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [term 1 LEADER]: Becoming Leader. State: Replica: 5b331a114e4e4e4c93f01e69971110ac, State: Running, Role: LEADER
I20260806 02:19:07.753880 10743 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b331a114e4e4e4c93f01e69971110ac" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42517 } }
I20260806 02:19:07.754451 10735 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:19:07.756119 10744 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b331a114e4e4e4c93f01e69971110ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b331a114e4e4e4c93f01e69971110ac" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42517 } } }
I20260806 02:19:07.756249 10744 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [sys.catalog]: This master's current role is: LEADER
I20260806 02:19:07.756641 10745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b331a114e4e4e4c93f01e69971110ac. Latest consensus state: current_term: 1 leader_uuid: "5b331a114e4e4e4c93f01e69971110ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b331a114e4e4e4c93f01e69971110ac" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42517 } } }
I20260806 02:19:07.756734 10745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac [sys.catalog]: This master's current role is: LEADER
I20260806 02:19:07.756953 10735 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 02:19:07.757496 10759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:19:07.763185 10759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:19:07.772810 10759 catalog_manager.cc:1347] Generated new cluster ID: d37a3cf646774f9aa1335ac92180c3b8
I20260806 02:19:07.772897 10759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:19:07.786895 10759 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:19:07.788415 10759 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:19:07.800092 10759 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac: Generated new TSK 0
I20260806 02:19:07.801160 10759 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:19:08.660753 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.189.148:43007/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42517
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:19:08.837008 10796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:19:08.837858 10796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:19:08.837998 10796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:19:08.844384 10796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:19:08.844556 10796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:19:08.844714 10796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:19:08.852833 10796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.189.148:43007/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:19:08.854579 10796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:19:08.856096 10796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:19:08.869653 10804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:08.869846 10807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:08.869678 10803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:19:08.870347 10796 server_base.cc:1034] running on GCE node
I20260806 02:19:08.870936 10796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:19:08.871749 10796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:19:08.872954 10796 hybrid_clock.cc:648] HybridClock initialized: now 1785982748872922 us; error 47 us; skew 500 ppm
Aug 06 02:19:08 dist-test-slave-gkw7 krb5kdc[10046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982748, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:19:08.876876 10796 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:19:08.878083 10796 webserver.cc:460] Webserver started at http://127.26.189.129:38759/ using document root <none> and password file <none>
I20260806 02:19:08.878858 10796 fs_manager.cc:359] Metadata directory not provided
I20260806 02:19:08.878961 10796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:19:08.879287 10796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 02:19:08 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982748, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:19:08.897787 10796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "b778354722024ca08ad56fad06b3ce0c"
format_stamp: "Formatted at 2026-08-06 02:19:08 on dist-test-slave-gkw7"
server_key: "b4f59ca6b54ab2bd5182acdd9630fd9d"
server_key_iv: "1458d76575b059fb3e31481fc6f9e160"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:08.898653 10796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "b778354722024ca08ad56fad06b3ce0c"
format_stamp: "Formatted at 2026-08-06 02:19:08 on dist-test-slave-gkw7"
server_key: "b4f59ca6b54ab2bd5182acdd9630fd9d"
server_key_iv: "1458d76575b059fb3e31481fc6f9e160"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:08.904246 10796 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 02:19:08.929497 10814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:08.931329 10796 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.002s sys 0.001s
I20260806 02:19:08.931550 10796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "b778354722024ca08ad56fad06b3ce0c"
format_stamp: "Formatted at 2026-08-06 02:19:08 on dist-test-slave-gkw7"
server_key: "b4f59ca6b54ab2bd5182acdd9630fd9d"
server_key_iv: "1458d76575b059fb3e31481fc6f9e160"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:08.931883 10796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:19:08.950264 10796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:19:08.955077 10796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:19:08.955462 10796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:19:08.956429 10796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:19:08.957619 10796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:19:08.957736 10796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:08.957862 10796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:19:08.957947 10796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:08.971930 10796 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:36459
I20260806 02:19:08.973196 10796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:19:08.974649 10968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:36459 every 8 connection(s)
I20260806 02:19:08.975764 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 10796
I20260806 02:19:08.975912 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:19:08.976266 27382 external_mini_cluster.cc:1428] Setting key 9edfb68c9f6098977ba886f7bc1ad7b7
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
Aug 06 02:19:08 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982748, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:19:09.004060 10973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:08.981983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:52219 (local address 127.26.189.190:42517)
0806 02:19:08.989767 (+ 7784us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:08.989774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:08.989792 (+ 18us) server_negotiation.cc:407] Connection header received
0806 02:19:08.989839 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:08.989842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:08.989894 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:08.989988 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:19:08.991644 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:08.992505 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:08.994494 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:08.994943 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:08.995125 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:08.999123 (+ 3998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:19:08.999128 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:19:08.999131 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:19:08.999165 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:19:09.001236 (+ 2071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:09.001969 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:09.001974 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:09.001976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:09.002084 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:09.002535 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:09.002539 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:09.002542 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:09.002812 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:19:09.002921 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:09.003700 (+ 779us) server_negotiation.cc:299] Negotiation successful
0806 02:19:09.003851 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7691,"thread_start_us":108,"threads_started":1}
I20260806 02:19:09.005183 10975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:08.982598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:42517 (local address 127.26.189.129:52219)
0806 02:19:08.983239 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0806 02:19:08.983301 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 02:19:08.984340 (+ 1039us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:19:08.990350 (+ 6010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:19:08.990360 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:19:08.990729 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:19:08.991451 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:08.991472 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:08.992690 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:08.992694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:08.994342 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:08.994356 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:08.995172 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:08.995177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:08.995524 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:08.996337 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:19:08.996361 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:19:08.998874 (+ 2513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:19:09.001386 (+ 2512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:19:09.001393 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:19:09.001412 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:19:09.001845 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:19:09.002205 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:19:09.002209 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:19:09.002210 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:19:09.002405 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:19:09.002948 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:19:09.002955 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:19:09.003347 (+ 392us) client_negotiation.cc:769] Sending connection context
0806 02:19:09.003597 (+ 250us) client_negotiation.cc:240] Negotiation successful
0806 02:19:09.003998 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":167,"threads_started":1}
I20260806 02:19:09.006886 10969 heartbeater.cc:347] Connected to a master server at 127.26.189.190:42517
I20260806 02:19:09.007201 10969 heartbeater.cc:464] Registering TS with master...
I20260806 02:19:09.007822 10969 heartbeater.cc:511] Master 127.26.189.190:42517 requested a full tablet report, sending...
I20260806 02:19:09.009874 10690 ts_manager.cc:194] Registered new tserver with Master: b778354722024ca08ad56fad06b3ce0c (127.26.189.129:36459)
I20260806 02:19:09.011579 10690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:52219
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:19:09.021507 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.189.148:43007/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42517
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 02:19:09 dist-test-slave-gkw7 krb5kdc[10046](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785982749, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 02:19:09.191067 10977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:19:09.191519 10977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:19:09.191648 10977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:19:09.197731 10977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:19:09.197870 10977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:19:09.198017 10977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:19:09.206048 10977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.189.148:43007/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:19:09.207521 10977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:19:09.208911 10977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:19:09.221753 10985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:09.221840 10989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:09.222093 10987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:19:09.222658 10977 server_base.cc:1034] running on GCE node
I20260806 02:19:09.223142 10977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:19:09.223980 10977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:19:09.225188 10977 hybrid_clock.cc:648] HybridClock initialized: now 1785982749225158 us; error 45 us; skew 500 ppm
Aug 06 02:19:09 dist-test-slave-gkw7 krb5kdc[10046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982749, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:19:09.229106 10977 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:19:09.230355 10977 webserver.cc:460] Webserver started at http://127.26.189.130:45765/ using document root <none> and password file <none>
I20260806 02:19:09.231256 10977 fs_manager.cc:359] Metadata directory not provided
I20260806 02:19:09.231364 10977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:19:09.231650 10977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 02:19:09 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982749, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:19:09.259783 10977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "b56ccc3cb70b47078bb6716f40ec89ee"
format_stamp: "Formatted at 2026-08-06 02:19:09 on dist-test-slave-gkw7"
server_key: "9452ba4dbe2f299c32e436eff1c671d0"
server_key_iv: "8132abc5cd03a65259d4a8dbb2247505"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:09.261466 10977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "b56ccc3cb70b47078bb6716f40ec89ee"
format_stamp: "Formatted at 2026-08-06 02:19:09 on dist-test-slave-gkw7"
server_key: "9452ba4dbe2f299c32e436eff1c671d0"
server_key_iv: "8132abc5cd03a65259d4a8dbb2247505"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:09.267165 10977 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 02:19:09.300264 10996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:09.302122 10977 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.002s sys 0.000s
I20260806 02:19:09.302284 10977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "b56ccc3cb70b47078bb6716f40ec89ee"
format_stamp: "Formatted at 2026-08-06 02:19:09 on dist-test-slave-gkw7"
server_key: "9452ba4dbe2f299c32e436eff1c671d0"
server_key_iv: "8132abc5cd03a65259d4a8dbb2247505"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:09.302433 10977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:19:09.337644 10977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:19:09.341572 10977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:19:09.341789 10977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:19:09.342566 10977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:19:09.343689 10977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:19:09.343757 10977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:09.343819 10977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:19:09.343842 10977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:09.358204 10977 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:41061
I20260806 02:19:09.359457 10977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:19:09.363374 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 10977
I20260806 02:19:09.363493 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:19:09.363811 27382 external_mini_cluster.cc:1428] Setting key be789067940503b618ce1cc5dbec5bfa
I20260806 02:19:09.361092 11144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:41061 every 8 connection(s)
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
Aug 06 02:19:09 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982749, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:19:09.400892 10973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:09.364970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:60141 (local address 127.26.189.190:42517)
0806 02:19:09.365088 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:09.365092 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:09.382290 (+ 17198us) server_negotiation.cc:407] Connection header received
0806 02:19:09.383770 (+ 1480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:09.383774 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:09.383845 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:09.383905 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:19:09.385853 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.386725 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.388613 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.389043 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.389139 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:09.395233 (+ 6094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:19:09.395237 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:19:09.395240 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:19:09.395273 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:19:09.397232 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:09.398838 (+ 1606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:09.398842 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:09.398844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:09.398944 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:09.399400 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:09.399404 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:09.399405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:09.399665 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:19:09.399759 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:09.400531 (+ 772us) server_negotiation.cc:299] Negotiation successful
0806 02:19:09.400678 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 02:19:09.402238 11147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:09.363887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:42517 (local address 127.26.189.130:60141)
0806 02:19:09.382042 (+ 18155us) negotiation.cc:107] Waiting for socket to connect
0806 02:19:09.382139 (+ 97us) client_negotiation.cc:174] Beginning negotiation
0806 02:19:09.383447 (+ 1308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:19:09.384416 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:19:09.384427 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:19:09.384838 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:19:09.385652 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:09.385677 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.386916 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.386921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:09.388462 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:09.388476 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.389380 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.389386 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:09.389667 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:09.393030 (+ 3363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:19:09.393056 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:19:09.395001 (+ 1945us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:19:09.398281 (+ 3280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:19:09.398288 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:19:09.398309 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:19:09.398699 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:19:09.399067 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:19:09.399070 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:19:09.399072 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:19:09.399275 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:19:09.399837 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:19:09.399844 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:19:09.400227 (+ 383us) client_negotiation.cc:769] Sending connection context
0806 02:19:09.400471 (+ 244us) client_negotiation.cc:240] Negotiation successful
0806 02:19:09.400833 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17774,"thread_start_us":130,"threads_started":1}
I20260806 02:19:09.403667 11145 heartbeater.cc:347] Connected to a master server at 127.26.189.190:42517
I20260806 02:19:09.403937 11145 heartbeater.cc:464] Registering TS with master...
I20260806 02:19:09.404544 11145 heartbeater.cc:511] Master 127.26.189.190:42517 requested a full tablet report, sending...
I20260806 02:19:09.405850 10690 ts_manager.cc:194] Registered new tserver with Master: b56ccc3cb70b47078bb6716f40ec89ee (127.26.189.130:41061)
I20260806 02:19:09.406662 10690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:60141
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:19:09.410287 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.189.148:43007/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42517
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 02:19:09 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982749, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
W20260806 02:19:09.584055 11153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:19:09.584409 11153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:19:09.584470 11153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:19:09.590413 11153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:19:09.590507 11153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:19:09.590610 11153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:19:09.598831 11153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.189.148:43007/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:19:09.600373 11153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:19:09.601752 11153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:19:09.615934 11161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:09.616420 11160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:09.617866 11165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:19:09.621727 11153 server_base.cc:1034] running on GCE node
I20260806 02:19:09.622467 11153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:19:09.623378 11153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:19:09.630909 11153 hybrid_clock.cc:648] HybridClock initialized: now 1785982749630826 us; error 111 us; skew 500 ppm
Aug 06 02:19:09 dist-test-slave-gkw7 krb5kdc[10046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982749, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:19:09.635190 11153 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:19:09.636452 11153 webserver.cc:460] Webserver started at http://127.26.189.131:33281/ using document root <none> and password file <none>
I20260806 02:19:09.637213 11153 fs_manager.cc:359] Metadata directory not provided
I20260806 02:19:09.637430 11153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:19:09.637804 11153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 02:19:09 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982749, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:19:09.670948 11153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "29114e027e6448d6b7ec647241a8381a"
format_stamp: "Formatted at 2026-08-06 02:19:09 on dist-test-slave-gkw7"
server_key: "0daa15aed74cb01f183a5bcf0190e311"
server_key_iv: "4eac5035286f1ea6640aad1c1dc8063b"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:09.672914 11153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "29114e027e6448d6b7ec647241a8381a"
format_stamp: "Formatted at 2026-08-06 02:19:09 on dist-test-slave-gkw7"
server_key: "0daa15aed74cb01f183a5bcf0190e311"
server_key_iv: "4eac5035286f1ea6640aad1c1dc8063b"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:09.678874 11153 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 02:19:09.709296 11172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:09.711068 11153 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:19:09.711198 11153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "29114e027e6448d6b7ec647241a8381a"
format_stamp: "Formatted at 2026-08-06 02:19:09 on dist-test-slave-gkw7"
server_key: "0daa15aed74cb01f183a5bcf0190e311"
server_key_iv: "4eac5035286f1ea6640aad1c1dc8063b"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:09.711359 11153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:19:09.727986 11153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:19:09.732093 11153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:19:09.732345 11153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:19:09.733029 11153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:19:09.734227 11153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:19:09.734300 11153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:09.734359 11153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:19:09.734396 11153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:09.747089 11153 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:33915
I20260806 02:19:09.747159 11335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:33915 every 8 connection(s)
I20260806 02:19:09.748385 11153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:19:09.749099 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 11153
I20260806 02:19:09.749220 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:19:09.749590 27382 external_mini_cluster.cc:1428] Setting key 27803f84fd669a35321071e52bbac93b
Aug 06 02:19:09 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982749, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:19:09.769593 10973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:09.752435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:57527 (local address 127.26.189.190:42517)
0806 02:19:09.752561 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:09.752565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:09.752946 (+ 381us) server_negotiation.cc:407] Connection header received
0806 02:19:09.754197 (+ 1251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:09.754201 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:09.754261 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:09.754319 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:19:09.756134 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.756972 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.759164 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.759509 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.759597 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:09.764959 (+ 5362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:19:09.764963 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:19:09.764966 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:19:09.764997 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:19:09.766896 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:09.767614 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:09.767618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:09.767620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:09.767734 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:09.768186 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:09.768189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:09.768191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:09.768433 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:19:09.768515 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:09.769254 (+ 739us) server_negotiation.cc:299] Negotiation successful
0806 02:19:09.769389 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 02:19:09.771643 11339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:09.751333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:42517 (local address 127.26.189.131:57527)
0806 02:19:09.752750 (+ 1417us) negotiation.cc:107] Waiting for socket to connect
0806 02:19:09.752811 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 02:19:09.753936 (+ 1125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:19:09.754784 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:19:09.754794 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:19:09.755184 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:19:09.755940 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:09.755962 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.757141 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.757144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:09.758629 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:09.758651 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.759842 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.759846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:09.760116 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:09.760902 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:19:09.760924 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:19:09.764744 (+ 3820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:19:09.767056 (+ 2312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:19:09.767063 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:19:09.767085 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:19:09.767482 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:19:09.767856 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:19:09.767859 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:19:09.767861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:19:09.768058 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:19:09.768586 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:19:09.768592 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:19:09.768953 (+ 361us) client_negotiation.cc:769] Sending connection context
0806 02:19:09.770078 (+ 1125us) client_negotiation.cc:240] Negotiation successful
0806 02:19:09.770450 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1165,"thread_start_us":139,"threads_started":1}
I20260806 02:19:09.773288 11337 heartbeater.cc:347] Connected to a master server at 127.26.189.190:42517
I20260806 02:19:09.773659 11337 heartbeater.cc:464] Registering TS with master...
I20260806 02:19:09.774276 11337 heartbeater.cc:511] Master 127.26.189.190:42517 requested a full tablet report, sending...
I20260806 02:19:09.776355 10693 ts_manager.cc:194] Registered new tserver with Master: 29114e027e6448d6b7ec647241a8381a (127.26.189.131:33915)
I20260806 02:19:09.777117 10693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:57527
I20260806 02:19:09.788268 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:19:09.819976 10973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:09.796695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38376 (local address 127.26.189.190:42517)
0806 02:19:09.796819 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:09.796824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:09.805909 (+ 9085us) server_negotiation.cc:407] Connection header received
0806 02:19:09.806131 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:09.806135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:09.806193 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:09.806252 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:19:09.807360 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.808198 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.813661 (+ 5463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.814032 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.814120 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:09.816123 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:19:09.816127 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:19:09.816130 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:19:09.816162 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:19:09.817989 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:09.818506 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:09.818509 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:09.818511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:09.818602 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:09.818930 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:09.818934 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:09.818936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:09.819162 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:19:09.819291 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:09.819670 (+ 379us) server_negotiation.cc:299] Negotiation successful
0806 02:19:09.819796 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 02:19:09.824301 10693 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38376:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:19:09.828864 10693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:19:09.887332 11364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:09.871242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:36459 (local address 127.0.0.1:60728)
0806 02:19:09.877966 (+ 6724us) negotiation.cc:107] Waiting for socket to connect
0806 02:19:09.877978 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:19:09.878042 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:19:09.882399 (+ 4357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:19:09.882402 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:19:09.882419 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:19:09.882511 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:09.882516 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.883877 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.883880 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:09.885345 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:09.885353 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.886688 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.886692 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:09.886854 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:09.886904 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 02:19:09.887019 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 02:19:09.887158 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6676,"thread_start_us":90,"threads_started":1}
I20260806 02:19:09.888293 11365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:09.871410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60728 (local address 127.26.189.129:36459)
0806 02:19:09.881756 (+ 10346us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:09.881764 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:09.881789 (+ 25us) server_negotiation.cc:407] Connection header received
0806 02:19:09.881891 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:09.881897 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:09.882086 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:09.882245 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:19:09.882639 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.883736 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.885476 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.886352 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.886468 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:09.886618 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:09.888004 (+ 1386us) server_negotiation.cc:299] Negotiation successful
0806 02:19:09.888116 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10221,"thread_start_us":114,"threads_started":1}
I20260806 02:19:09.888476 11360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:09.868050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:33915 (local address 127.0.0.1:35478)
0806 02:19:09.876337 (+ 8287us) negotiation.cc:107] Waiting for socket to connect
0806 02:19:09.876404 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 02:19:09.876542 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:19:09.878151 (+ 1609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:19:09.878159 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:19:09.878181 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:19:09.878332 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:09.878339 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.885308 (+ 6969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.885312 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:09.886540 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:09.886551 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.888008 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.888013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:09.888108 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:09.888132 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 02:19:09.888196 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 02:19:09.888271 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8066,"thread_start_us":103,"threads_started":1}
I20260806 02:19:09.889159 11361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:09.869054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35478 (local address 127.26.189.131:33915)
0806 02:19:09.876889 (+ 7835us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:09.876902 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:09.876929 (+ 27us) server_negotiation.cc:407] Connection header received
0806 02:19:09.877013 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:09.877019 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:09.877262 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:09.877426 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:19:09.878483 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.885169 (+ 6686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.886809 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.887657 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.887791 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:09.887941 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:09.888854 (+ 913us) server_negotiation.cc:299] Negotiation successful
0806 02:19:09.889019 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7712,"thread_start_us":130,"threads_started":1}
I20260806 02:19:09.890787 11362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:09.870539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:41061 (local address 127.0.0.1:33254)
0806 02:19:09.877714 (+ 7175us) negotiation.cc:107] Waiting for socket to connect
0806 02:19:09.877728 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:19:09.877813 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:19:09.878610 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:19:09.878614 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:19:09.878638 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:19:09.878754 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:09.878762 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.887249 (+ 8487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.887254 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:09.888674 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:09.888687 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.890291 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.890296 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:09.890411 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:09.890440 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 02:19:09.890531 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 02:19:09.890624 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7099,"thread_start_us":97,"threads_started":1}
I20260806 02:19:09.891963 10877 tablet_service.cc:1467] Processing CreateTablet for tablet cc48c745a6d64941a181309aa727ea47 (DEFAULT_TABLE table=test-table [id=60ecc4e7a8244c158658bb34ae82e7e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:19:09.893203 10877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc48c745a6d64941a181309aa727ea47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:19:09.893287 11221 tablet_service.cc:1467] Processing CreateTablet for tablet cc48c745a6d64941a181309aa727ea47 (DEFAULT_TABLE table=test-table [id=60ecc4e7a8244c158658bb34ae82e7e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:19:09.894480 11221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc48c745a6d64941a181309aa727ea47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:19:09.904819 11363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:09.870753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33254 (local address 127.26.189.130:41061)
0806 02:19:09.877815 (+ 7062us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:09.877837 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:09.877910 (+ 73us) server_negotiation.cc:407] Connection header received
0806 02:19:09.878006 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:09.878012 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:09.878232 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:09.878416 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:19:09.885658 (+ 7242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.887046 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.888901 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:09.889913 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:09.890068 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:09.890211 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:09.904445 (+ 14234us) server_negotiation.cc:299] Negotiation successful
0806 02:19:09.904613 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6917,"thread_start_us":127,"threads_started":1}
I20260806 02:19:09.907346 11366 tablet_bootstrap.cc:492] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a: Bootstrap starting.
I20260806 02:19:09.908275 11058 tablet_service.cc:1467] Processing CreateTablet for tablet cc48c745a6d64941a181309aa727ea47 (DEFAULT_TABLE table=test-table [id=60ecc4e7a8244c158658bb34ae82e7e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:19:09.909508 11058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc48c745a6d64941a181309aa727ea47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:19:09.910115 11367 tablet_bootstrap.cc:492] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c: Bootstrap starting.
I20260806 02:19:09.912756 11367 tablet_bootstrap.cc:654] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c: Neither blocks nor log segments found. Creating new log.
I20260806 02:19:09.913713 11367 log.cc:824] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c: Log is configured to *not* fsync() on all Append() calls
I20260806 02:19:09.917737 11366 tablet_bootstrap.cc:654] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a: Neither blocks nor log segments found. Creating new log.
I20260806 02:19:09.918830 11366 log.cc:824] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a: Log is configured to *not* fsync() on all Append() calls
I20260806 02:19:09.927804 11367 tablet_bootstrap.cc:492] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c: No bootstrap required, opened a new log
I20260806 02:19:09.928069 11367 ts_tablet_manager.cc:1397] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260806 02:19:09.930070 11370 tablet_bootstrap.cc:492] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee: Bootstrap starting.
I20260806 02:19:09.932229 11366 tablet_bootstrap.cc:492] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a: No bootstrap required, opened a new log
I20260806 02:19:09.932488 11366 ts_tablet_manager.cc:1397] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.000s
I20260806 02:19:09.932699 11367 raft_consensus.cc:348] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29114e027e6448d6b7ec647241a8381a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33915 } } peers { permanent_uuid: "b56ccc3cb70b47078bb6716f40ec89ee" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 41061 } } peers { permanent_uuid: "b778354722024ca08ad56fad06b3ce0c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36459 } }
I20260806 02:19:09.933001 11367 raft_consensus.cc:374] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:19:09.933010 11370 tablet_bootstrap.cc:654] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee: Neither blocks nor log segments found. Creating new log.
I20260806 02:19:09.933058 11367 raft_consensus.cc:729] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778354722024ca08ad56fad06b3ce0c, State: Initialized, Role: FOLLOWER
I20260806 02:19:09.933632 11367 consensus_queue.cc:260] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29114e027e6448d6b7ec647241a8381a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33915 } } peers { permanent_uuid: "b56ccc3cb70b47078bb6716f40ec89ee" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 41061 } } peers { permanent_uuid: "b778354722024ca08ad56fad06b3ce0c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36459 } }
I20260806 02:19:09.934098 11370 log.cc:824] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee: Log is configured to *not* fsync() on all Append() calls
I20260806 02:19:09.934820 11367 ts_tablet_manager.cc:1428] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 02:19:09.937077 10969 heartbeater.cc:503] Master 127.26.189.190:42517 was elected leader, sending a full tablet report...
I20260806 02:19:09.937377 11366 raft_consensus.cc:348] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29114e027e6448d6b7ec647241a8381a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33915 } } peers { permanent_uuid: "b56ccc3cb70b47078bb6716f40ec89ee" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 41061 } } peers { permanent_uuid: "b778354722024ca08ad56fad06b3ce0c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36459 } }
I20260806 02:19:09.937813 11366 raft_consensus.cc:374] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:19:09.937891 11366 raft_consensus.cc:729] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29114e027e6448d6b7ec647241a8381a, State: Initialized, Role: FOLLOWER
I20260806 02:19:09.938476 11366 consensus_queue.cc:260] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29114e027e6448d6b7ec647241a8381a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33915 } } peers { permanent_uuid: "b56ccc3cb70b47078bb6716f40ec89ee" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 41061 } } peers { permanent_uuid: "b778354722024ca08ad56fad06b3ce0c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36459 } }
I20260806 02:19:09.939643 11366 ts_tablet_manager.cc:1428] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 02:19:09.947482 11337 heartbeater.cc:503] Master 127.26.189.190:42517 was elected leader, sending a full tablet report...
I20260806 02:19:09.952024 11370 tablet_bootstrap.cc:492] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee: No bootstrap required, opened a new log
I20260806 02:19:09.952322 11370 ts_tablet_manager.cc:1397] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260806 02:19:09.957930 11370 raft_consensus.cc:348] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29114e027e6448d6b7ec647241a8381a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33915 } } peers { permanent_uuid: "b56ccc3cb70b47078bb6716f40ec89ee" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 41061 } } peers { permanent_uuid: "b778354722024ca08ad56fad06b3ce0c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36459 } }
I20260806 02:19:09.958289 11370 raft_consensus.cc:374] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:19:09.958356 11370 raft_consensus.cc:729] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56ccc3cb70b47078bb6716f40ec89ee, State: Initialized, Role: FOLLOWER
I20260806 02:19:09.958938 11370 consensus_queue.cc:260] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29114e027e6448d6b7ec647241a8381a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33915 } } peers { permanent_uuid: "b56ccc3cb70b47078bb6716f40ec89ee" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 41061 } } peers { permanent_uuid: "b778354722024ca08ad56fad06b3ce0c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36459 } }
I20260806 02:19:09.960381 11370 ts_tablet_manager.cc:1428] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260806 02:19:09.960860 11145 heartbeater.cc:503] Master 127.26.189.190:42517 was elected leader, sending a full tablet report...
W20260806 02:19:09.977066 10971 tablet.cc:2369] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:19:10.009092 11372 raft_consensus.cc:482] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:19:10.009374 11372 raft_consensus.cc:504] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29114e027e6448d6b7ec647241a8381a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33915 } } peers { permanent_uuid: "b56ccc3cb70b47078bb6716f40ec89ee" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 41061 } } peers { permanent_uuid: "b778354722024ca08ad56fad06b3ce0c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36459 } }
W20260806 02:19:10.009403 11346 tablet.cc:2369] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:19:10.010782 11372 leader_election.cc:288] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29114e027e6448d6b7ec647241a8381a (127.26.189.131:33915), b56ccc3cb70b47078bb6716f40ec89ee (127.26.189.130:41061)
I20260806 02:19:10.020500 11361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:10.011613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:32959 (local address 127.26.189.131:33915)
0806 02:19:10.011754 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:10.011761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:10.014384 (+ 2623us) server_negotiation.cc:407] Connection header received
0806 02:19:10.014602 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:10.014605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:10.014660 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:10.014711 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:19:10.015110 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:10.015898 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:10.019116 (+ 3218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:10.019762 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:10.019857 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:10.019911 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:10.020281 (+ 370us) server_negotiation.cc:299] Negotiation successful
0806 02:19:10.020360 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 02:19:10.020963 11379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:10.011194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:33915 (local address 127.26.189.129:32959)
0806 02:19:10.014271 (+ 3077us) negotiation.cc:107] Waiting for socket to connect
0806 02:19:10.014288 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:19:10.014474 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:19:10.014864 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:19:10.014866 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:19:10.014883 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:19:10.014986 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:10.014992 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:10.016085 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:10.016088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:10.018964 (+ 2876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:10.018977 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:10.020011 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:10.020015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:10.020126 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:10.020162 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 02:19:10.020723 (+ 561us) client_negotiation.cc:240] Negotiation successful
0806 02:19:10.020809 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2998,"thread_start_us":125,"threads_started":1}
I20260806 02:19:10.021737 11243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc48c745a6d64941a181309aa727ea47" candidate_uuid: "b778354722024ca08ad56fad06b3ce0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29114e027e6448d6b7ec647241a8381a" is_pre_election: true
I20260806 02:19:10.022190 11243 raft_consensus.cc:2454] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778354722024ca08ad56fad06b3ce0c in term 0.
I20260806 02:19:10.022846 10816 leader_election.cc:302] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29114e027e6448d6b7ec647241a8381a, b778354722024ca08ad56fad06b3ce0c; no voters:
I20260806 02:19:10.023219 11372 raft_consensus.cc:2781] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:19:10.023326 11372 raft_consensus.cc:482] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:19:10.023388 11372 raft_consensus.cc:3037] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:19:10.024971 11372 raft_consensus.cc:504] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29114e027e6448d6b7ec647241a8381a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33915 } } peers { permanent_uuid: "b56ccc3cb70b47078bb6716f40ec89ee" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 41061 } } peers { permanent_uuid: "b778354722024ca08ad56fad06b3ce0c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36459 } }
I20260806 02:19:10.025429 11372 leader_election.cc:288] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [CANDIDATE]: Term 1 election: Requested vote from peers 29114e027e6448d6b7ec647241a8381a (127.26.189.131:33915), b56ccc3cb70b47078bb6716f40ec89ee (127.26.189.130:41061)
I20260806 02:19:10.026051 11243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc48c745a6d64941a181309aa727ea47" candidate_uuid: "b778354722024ca08ad56fad06b3ce0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29114e027e6448d6b7ec647241a8381a"
I20260806 02:19:10.026201 11363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:10.012224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:37155 (local address 127.26.189.130:41061)
0806 02:19:10.012382 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:10.012387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:10.021166 (+ 8779us) server_negotiation.cc:407] Connection header received
0806 02:19:10.021491 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:10.021494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:10.021566 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:10.021614 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:19:10.022103 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:10.022852 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:10.024713 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:10.025369 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:10.025467 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:10.025519 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:10.025991 (+ 472us) server_negotiation.cc:299] Negotiation successful
0806 02:19:10.026075 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 02:19:10.026212 11243 raft_consensus.cc:3037] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:19:10.026779 11380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:10.011868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:41061 (local address 127.26.189.129:37155)
0806 02:19:10.020974 (+ 9106us) negotiation.cc:107] Waiting for socket to connect
0806 02:19:10.020991 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:19:10.021353 (+ 362us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:19:10.021760 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:19:10.021763 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:19:10.021779 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:19:10.021898 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:10.021903 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:10.023116 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:10.023119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:10.024543 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:10.024555 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:10.025734 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:10.025737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:10.025842 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:10.025866 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 02:19:10.026536 (+ 670us) client_negotiation.cc:240] Negotiation successful
0806 02:19:10.026612 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9037,"mutex_wait_us":17,"thread_start_us":90,"threads_started":1}
I20260806 02:19:10.027591 11083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc48c745a6d64941a181309aa727ea47" candidate_uuid: "b778354722024ca08ad56fad06b3ce0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ccc3cb70b47078bb6716f40ec89ee" is_pre_election: true
I20260806 02:19:10.027755 11243 raft_consensus.cc:2454] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778354722024ca08ad56fad06b3ce0c in term 1.
I20260806 02:19:10.027969 11083 raft_consensus.cc:2454] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778354722024ca08ad56fad06b3ce0c in term 0.
I20260806 02:19:10.028177 10816 leader_election.cc:302] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29114e027e6448d6b7ec647241a8381a, b778354722024ca08ad56fad06b3ce0c; no voters:
I20260806 02:19:10.028388 11372 raft_consensus.cc:2781] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:19:10.028422 11080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc48c745a6d64941a181309aa727ea47" candidate_uuid: "b778354722024ca08ad56fad06b3ce0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ccc3cb70b47078bb6716f40ec89ee"
I20260806 02:19:10.028579 11080 raft_consensus.cc:3037] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:19:10.028679 11372 raft_consensus.cc:686] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [term 1 LEADER]: Becoming Leader. State: Replica: b778354722024ca08ad56fad06b3ce0c, State: Running, Role: LEADER
I20260806 02:19:10.029107 11372 consensus_queue.cc:237] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29114e027e6448d6b7ec647241a8381a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33915 } } peers { permanent_uuid: "b56ccc3cb70b47078bb6716f40ec89ee" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 41061 } } peers { permanent_uuid: "b778354722024ca08ad56fad06b3ce0c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36459 } }
I20260806 02:19:10.030167 11080 raft_consensus.cc:2454] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778354722024ca08ad56fad06b3ce0c in term 1.
I20260806 02:19:10.033107 10693 catalog_manager.cc:5495] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c reported cstate change: term changed from 0 to 1, leader changed from <none> to b778354722024ca08ad56fad06b3ce0c (127.26.189.129). New cstate: current_term: 1 leader_uuid: "b778354722024ca08ad56fad06b3ce0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29114e027e6448d6b7ec647241a8381a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b56ccc3cb70b47078bb6716f40ec89ee" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778354722024ca08ad56fad06b3ce0c" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36459 } health_report { overall_health: HEALTHY } } }
Aug 06 02:19:10 dist-test-slave-gkw7 krb5kdc[10046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982749, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:19:10.068140 11365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:10.062292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60742 (local address 127.26.189.129:36459)
0806 02:19:10.062456 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:10.062463 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:10.062485 (+ 22us) server_negotiation.cc:407] Connection header received
0806 02:19:10.062652 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:10.062659 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:10.062749 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:10.062893 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:19:10.063350 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:10.064180 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:10.065615 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:10.065968 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:10.066092 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:10.066618 (+ 526us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:19:10.067211 (+ 593us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:19:10.067351 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:10.067861 (+ 510us) server_negotiation.cc:299] Negotiation successful
0806 02:19:10.067936 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 02:19:10.084546 11243 raft_consensus.cc:1261] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a [term 1 FOLLOWER]: Refusing update from remote peer b778354722024ca08ad56fad06b3ce0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:19:10.084619 11080 raft_consensus.cc:1261] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee [term 1 FOLLOWER]: Refusing update from remote peer b778354722024ca08ad56fad06b3ce0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:19:10.085335 11383 consensus_queue.cc:1035] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29114e027e6448d6b7ec647241a8381a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:19:10.085637 11372 consensus_queue.cc:1035] T cc48c745a6d64941a181309aa727ea47 P b778354722024ca08ad56fad06b3ce0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ccc3cb70b47078bb6716f40ec89ee" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:19:10.101023 11388 mvcc.cc:205] Tried to move back new op lower bound from 7315385344336412672 to 7315385344123392000. Current Snapshot: MvccSnapshot[applied={T|T < 7315385344336412672}]
I20260806 02:19:10.102386 11389 mvcc.cc:205] Tried to move back new op lower bound from 7315385344336412672 to 7315385344123392000. Current Snapshot: MvccSnapshot[applied={T|T < 7315385344336412672}]
I20260806 02:19:10.122040 10693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:19:10.122269 10693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:19:10.125844 10693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b331a114e4e4e4c93f01e69971110ac: Sending DeleteTablet for 3 replicas of tablet cc48c745a6d64941a181309aa727ea47
I20260806 02:19:10.126847 11221 tablet_service.cc:1514] Processing DeleteTablet for tablet cc48c745a6d64941a181309aa727ea47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:19:10 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:35478
I20260806 02:19:10.128104 11058 tablet_service.cc:1514] Processing DeleteTablet for tablet cc48c745a6d64941a181309aa727ea47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:19:10 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:33254
I20260806 02:19:10.129244 10877 tablet_service.cc:1514] Processing DeleteTablet for tablet cc48c745a6d64941a181309aa727ea47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:19:10 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:60728
I20260806 02:19:10.130138 11401 tablet_replica.cc:330] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a: stopping tablet replica
I20260806 02:19:10.130507 11401 raft_consensus.cc:2229] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:19:10.130873 11401 raft_consensus.cc:2258] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:19:10.131734 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 10796
I20260806 02:19:10.134621 11402 tablet_replica.cc:330] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee: stopping tablet replica
I20260806 02:19:10.134900 11402 raft_consensus.cc:2229] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:19:10.135138 11402 raft_consensus.cc:2258] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:19:10.147449 11402 ts_tablet_manager.cc:1905] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:19:10.151010 11402 ts_tablet_manager.cc:1918] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:19:10.151134 11402 log.cc:1196] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/cc48c745a6d64941a181309aa727ea47
I20260806 02:19:10.151512 11402 ts_tablet_manager.cc:1939] T cc48c745a6d64941a181309aa727ea47 P b56ccc3cb70b47078bb6716f40ec89ee: Deleting consensus metadata
I20260806 02:19:10.153002 10674 catalog_manager.cc:4841] TS b56ccc3cb70b47078bb6716f40ec89ee (127.26.189.130:41061): tablet cc48c745a6d64941a181309aa727ea47 (table test-table [id=60ecc4e7a8244c158658bb34ae82e7e8]) successfully deleted
W20260806 02:19:10.154471 10672 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:36459 (error 108)
I20260806 02:19:10.154804 11401 ts_tablet_manager.cc:1905] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:19:10.155813 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 10977
I20260806 02:19:10.160202 11401 ts_tablet_manager.cc:1918] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:19:10.160326 11401 log.cc:1196] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/cc48c745a6d64941a181309aa727ea47
I20260806 02:19:10.160692 11401 ts_tablet_manager.cc:1939] T cc48c745a6d64941a181309aa727ea47 P 29114e027e6448d6b7ec647241a8381a: Deleting consensus metadata
I20260806 02:19:10.163187 10672 catalog_manager.cc:4841] TS 29114e027e6448d6b7ec647241a8381a (127.26.189.131:33915): tablet cc48c745a6d64941a181309aa727ea47 (table test-table [id=60ecc4e7a8244c158658bb34ae82e7e8]) successfully deleted
I20260806 02:19:10.163648 11362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:10.162982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:36459 (local address 127.0.0.1:60750)
0806 02:19:10.163462 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0806 02:19:10.163558 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:36459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386}
W20260806 02:19:10.163918 10672 catalog_manager.cc:4584] TS b778354722024ca08ad56fad06b3ce0c (127.26.189.129:36459): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cc48c745a6d64941a181309aa727ea47: Network error: Client connection negotiation failed: client connection to 127.26.189.129:36459: connect: Connection refused (error 111)
I20260806 02:19:10.173887 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 11153
I20260806 02:19:10.199422 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 10650
I20260806 02:19:10.213116 27382 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 02:19:10.560642 27382 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 02:19:10.560828 27382 mini_ranger.cc:66] Stopping Ranger...
I20260806 02:19:10.917078 27382 mini_ranger.cc:68] Stopped Ranger
2026-08-06 02:19:10.917 UTC [10086] LOG: received smart shutdown request
2026-08-06 02:19:10.920 UTC [10086] LOG: background worker "logical replication launcher" (PID 10101) exited with exit code 1
2026-08-06 02:19:10.921 UTC [10090] LOG: shutting down
2026-08-06 02:19:11.113 UTC [10086] LOG: database system is shut down
2026-08-06T02:19:11Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49919 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:19:11 dist-test-slave-gkw7 krb5kdc[11414](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:19:11 dist-test-slave-gkw7 krb5kdc[11414](info): set up 2 sockets
Aug 06 02:19:11 dist-test-slave-gkw7 krb5kdc[11414](info): commencing operation
krb5kdc: starting...
W20260806 02:19:12.468294 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:19:12 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982752, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:19:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:19:12Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.189.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.189.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/rangeradmin_127.26.189.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/rangeradmin_127.26.189.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.189.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.189.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/rangerlookup_127.26.189.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/rangerlookup_127.26.189.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.189.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.189.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/HTTP_127.26.189.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/HTTP_127.26.189.148@KRBTEST.COM.keytab.
I20260806 02:19:12.670207 27382 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskHiSG4m/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/postgres -l logfile start
2026-08-06 02:19:15.361 UTC [11448] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 02:19:15.361 UTC [11448] LOG: listening on IPv4 address "127.26.189.148", port 44627
2026-08-06 02:19:15.365 UTC [11448] LOG: listening on Unix socket "/tmp/.s.PGSQL.44627"
2026-08-06 02:19:15.391 UTC [11451] LOG: database system was shut down at 2026-08-06 02:19:13 UTC
2026-08-06 02:19:15.395 UTC [11448] LOG: database system is ready to accept connections
I20260806 02:19:16.501408 27382 mini_postgres.cc:96] Postgres bound to 44627
2026-08-06 02:19:16.508 UTC [11462] FATAL: database "slave" does not exist
127.26.189.148:44627 - accepting connections
I20260806 02:19:16.509500 27382 mini_ranger.cc:161] Starting Ranger...
I20260806 02:19:16.526101 27382 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 02:19:17.072383 27382 mini_ranger.cc:87] Created ranger Postgres database
I20260806 02:19:17.072490 27382 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-admin
2026-08-06 02:19:17,388 [I] DB FLAVOR :POSTGRES
2026-08-06 02:19:17,389 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 02:19:17,389 [I] Checking connection..
2026-08-06 02:19:17,389 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 02:19:17,655 [I] Checking connection passed.
2026-08-06 02:19:17,655 [I] --------- Verifying version history table ---------
2026-08-06 02:19:17,655 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 02:19:17,917 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 02:19:17,918 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 02:19:18,206 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 02:19:18,206 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 02:19:18,206 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 02:19:18.484 UTC [11552] WARNING: there is no transaction in progress
2026-08-06 02:19:18,493 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 02:19:18,494 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 02:19:18,760 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 02:19:18,760 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 02:19:18,761 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 02:19:19,025 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 02:19:19,294 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gkw7.c.gcp-upstream.internal','N') ;"
2026-08-06 02:19:19,552 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 02:19:19,809 [I] Table x_portal_user does not exist in database ranger
2026-08-06 02:19:19,809 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 02:19:20,057 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 02:19:20,057 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 02:19:20,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 02:19:20,569 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 02:19:20,570 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 02:19:21.588 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.605 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.622 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.637 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.654 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.673 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.730 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.737 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.753 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.764 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.774 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.788 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.798 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.805 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.811 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:21.818 UTC [11701] WARNING: there is no transaction in progress
2026-08-06 02:19:22,506 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 02:19:22,506 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 02:19:22,770 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 02:19:22,770 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 02:19:23,032 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 02:19:23,032 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 02:19:23,344 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 02:19:23,344 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 02:19:23,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 02:19:23,859 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gkw7.c.gcp-upstream.internal';"
2026-08-06 02:19:24,127 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 02:19:24,127 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 02:19:24,393 [I] DB_PATCHES have already been applied
I20260806 02:19:24.399889 27382 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-admin:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskHiSG4m/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 02:19:24.399955 27382 mini_ranger.cc:193] Using host: 127.26.189.148
I20260806 02:19:24.404255 27382 mini_ranger.cc:227] Ranger admin URL: http://127.26.189.148:49393
Aug 06, 2026 2:19:24 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 2:19:24 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 2:19:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 2:19:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 2:19:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 2:19:25 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 2:19:25 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 02:19:25.676712 27382 mini_ranger.cc:160] Time spent starting Ranger: real 9.167s user 0.000s sys 0.012s
Aug 06, 2026 2:19:47 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 2:19:47 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 06, 2026 2:19:47 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 2:19:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 2:19:47 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 2:19:48 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 02:19:49.205911 27382 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.189.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.189.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/rangerkms_127.26.189.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.189.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/rangerkms_127.26.189.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.189.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.189.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.189.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/HTTP_127.26.189.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.189.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/HTTP_127.26.189.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 02:19:49 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982789, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 02:19:49.303818 27382 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 02:19:49.314292 27382 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 02:19:50.254822 27382 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 02:19:50.255038 27382 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-kms
I20260806 02:19:50.255079 27382 mini_ranger_kms.cc:227] Using postgres at 127.26.189.148:44627
2026-08-06 02:19:50,469 [I] DB FLAVOR :POSTGRES
2026-08-06 02:19:50,469 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 02:19:50,469 [I] Checking connection
2026-08-06 02:19:50,469 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 02:19:50,720 [I] connection success
2026-08-06 02:19:50,720 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 02:19:50,720 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 02:19:50,720 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 02:19:50,979 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 02:19:50,979 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 02:19:50,980 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 02:19:50,980 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.189.148:44627/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 02:19:51,272 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 02:19:51.819654 27382 mini_ranger_kms.cc:310] Created kms service
I20260806 02:19:52.012954 27382 mini_ranger_kms.cc:326] Created kudu user
I20260806 02:19:52.061785 27382 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 02:19:52 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982789, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:19:52.502658 27382 mini_ranger_kms.cc:384] Added ranger policy
I20260806 02:19:52.502844 27382 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-kms:/tmp/dist-test-taskHiSG4m/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskHiSG4m/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 02:19:52.502878 27382 mini_ranger_kms.cc:240] Using host: 127.26.189.148
I20260806 02:19:52.507961 27382 mini_ranger_kms.cc:276] Ranger KMS PID: 11957
I20260806 02:19:52.508073 27382 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.189.148:50469
Aug 06, 2026 2:19:53 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 2:19:53 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 2:19:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 2:19:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 2:19:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 2:19:54 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 02:19:54 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785982794, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.189.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 02:19:55 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982794, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.189.148@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:19:55.283821 27382 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.980s user 0.011s sys 0.188s
I20260806 02:19:55.283967 27382 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 02:19:55.284040 27382 mini_ranger_kms.cc:401] 127.26.189.148:50469/kms/v1/keys
Aug 06 02:19:55 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982794, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.189.148@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
Aug 06 02:19:57 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:19:57.961143 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:43129
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:43129
--ranger_config_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.189.148:50469/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:19:58.079855 12026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:19:58.080142 12026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:19:58.080183 12026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:19:58.084362 12026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:19:58.084436 12026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:19:58.084455 12026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:19:58.084472 12026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:19:58.084488 12026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:19:58.090444 12026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.189.148:50469/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:43129
--ranger_config_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:43129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:19:58.091558 12026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:19:58.092607 12026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:19:58.102098 12033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:58.102144 12039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:58.102130 12035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:19:58.102334 12026 server_base.cc:1034] running on GCE node
I20260806 02:19:58.103061 12026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:19:58.104202 12026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:19:58.105475 12026 hybrid_clock.cc:648] HybridClock initialized: now 1785982798105455 us; error 36 us; skew 500 ppm
Aug 06 02:19:58 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982798, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:19:58.116751 12026 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:19:58.118173 12026 webserver.cc:460] Webserver started at http://127.26.189.190:45183/ using document root <none> and password file <none>
I20260806 02:19:58.118835 12026 fs_manager.cc:359] Metadata directory not provided
I20260806 02:19:58.118929 12026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:19:58.119186 12026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 02:19:58 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982798, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:19:58.174103 12026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "2cc0e7b7a6df41b5a1433ec15365c47c"
format_stamp: "Formatted at 2026-08-06 02:19:58 on dist-test-slave-gkw7"
server_key: "a0758ab8aed97d083967ed181430b702"
server_key_iv: "f5d107790c3b52d6ea254b9e7a053a4c"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:58.174841 12026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "2cc0e7b7a6df41b5a1433ec15365c47c"
format_stamp: "Formatted at 2026-08-06 02:19:58 on dist-test-slave-gkw7"
server_key: "a0758ab8aed97d083967ed181430b702"
server_key_iv: "f5d107790c3b52d6ea254b9e7a053a4c"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:58.179327 12026 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:19:58.199291 12046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:58.200884 12026 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 02:19:58.201062 12026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "2cc0e7b7a6df41b5a1433ec15365c47c"
format_stamp: "Formatted at 2026-08-06 02:19:58 on dist-test-slave-gkw7"
server_key: "a0758ab8aed97d083967ed181430b702"
server_key_iv: "f5d107790c3b52d6ea254b9e7a053a4c"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:58.201217 12026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:19:58.214850 12026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:19:58.218384 12026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:19:58.218947 12026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:19:58.227715 12026 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:43129
I20260806 02:19:58.227756 12120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:43129 every 8 connection(s)
I20260806 02:19:58.228838 12026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:19:58.230289 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 12026
I20260806 02:19:58.230455 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:19:58.230778 27382 external_mini_cluster.cc:1428] Setting key 8a5fa09284f35722134dc7323e1a9d28
I20260806 02:19:58.232436 12122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:19:58.239480 12122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c: Bootstrap starting.
Aug 06 02:19:58 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:19:58.242205 12122 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c: Neither blocks nor log segments found. Creating new log.
I20260806 02:19:58.243597 12122 log.cc:824] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c: Log is configured to *not* fsync() on all Append() calls
I20260806 02:19:58.245940 12122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c: No bootstrap required, opened a new log
I20260806 02:19:58.247917 12126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:58.232305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38820 (local address 127.26.189.190:43129)
0806 02:19:58.232794 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:58.232818 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:58.233062 (+ 244us) server_negotiation.cc:407] Connection header received
0806 02:19:58.233989 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:58.234008 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:58.234370 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:58.234746 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:19:58.235628 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:58.236729 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:58.237795 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:58.238315 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:58.238504 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:58.241479 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:19:58.241484 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:19:58.241498 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:19:58.241575 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:19:58.243554 (+ 1979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:58.244086 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:58.244095 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:58.244105 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:58.244269 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:58.245629 (+ 1360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:58.245632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:58.245634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:58.246151 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:19:58.246359 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:58.246710 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 02:19:58.247006 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":155,"threads_started":1}
I20260806 02:19:58.249799 12122 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43129 } }
I20260806 02:19:58.250087 12122 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:19:58.250214 12122 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cc0e7b7a6df41b5a1433ec15365c47c, State: Initialized, Role: FOLLOWER
I20260806 02:19:58.250712 12122 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43129 } }
I20260806 02:19:58.250849 12122 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:19:58.250945 12122 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:19:58.251058 12122 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:19:58.252029 12122 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43129 } }
I20260806 02:19:58.252408 12122 leader_election.cc:302] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2cc0e7b7a6df41b5a1433ec15365c47c; no voters:
I20260806 02:19:58.252755 12122 leader_election.cc:288] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:19:58.252875 12130 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:19:58.253080 12130 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 1 LEADER]: Becoming Leader. State: Replica: 2cc0e7b7a6df41b5a1433ec15365c47c, State: Running, Role: LEADER
I20260806 02:19:58.253429 12130 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43129 } }
I20260806 02:19:58.254189 12122 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:19:58.254942 12130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2cc0e7b7a6df41b5a1433ec15365c47c. Latest consensus state: current_term: 1 leader_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43129 } } }
I20260806 02:19:58.255059 12130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [sys.catalog]: This master's current role is: LEADER
I20260806 02:19:58.255424 12146 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:19:58.256094 12132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43129 } } }
I20260806 02:19:58.256289 12132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [sys.catalog]: This master's current role is: LEADER
I20260806 02:19:58.258569 12146 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:19:58.259157 12122 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 02:19:58.270740 12146 catalog_manager.cc:1347] Generated new cluster ID: 8932190d1ede401886727db113ebd359
I20260806 02:19:58.270839 12146 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:19:58.309994 12146 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:19:58.311398 12146 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:19:58.326995 12146 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c: Generated new TSK 0
I20260806 02:19:58.328032 12146 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:19:59.105955 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.189.148:50469/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:43129
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:19:59.260500 12193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:19:59.260809 12193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:19:59.260934 12193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:19:59.265779 12193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:19:59.265865 12193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:19:59.265978 12193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:19:59.272051 12193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.189.148:50469/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:43129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:19:59.273568 12193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:19:59.275231 12193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:19:59.288347 12203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:59.288457 12206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:59.288347 12204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:19:59.289682 12193 server_base.cc:1034] running on GCE node
I20260806 02:19:59.290194 12193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:19:59.290900 12193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:19:59.292059 12193 hybrid_clock.cc:648] HybridClock initialized: now 1785982799292025 us; error 47 us; skew 500 ppm
Aug 06 02:19:59 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:19:59.295349 12193 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:19:59.296501 12193 webserver.cc:460] Webserver started at http://127.26.189.129:33009/ using document root <none> and password file <none>
I20260806 02:19:59.297283 12193 fs_manager.cc:359] Metadata directory not provided
I20260806 02:19:59.297438 12193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:19:59.297793 12193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 02:19:59 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:19:59.316147 12193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "5cabbfb55e194ac8965872bad139793d"
format_stamp: "Formatted at 2026-08-06 02:19:59 on dist-test-slave-gkw7"
server_key: "37869f214353aae21d56bc1c3139b2c2"
server_key_iv: "314a0c82fae5f33eec11e55aa26c408c"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:59.316982 12193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "5cabbfb55e194ac8965872bad139793d"
format_stamp: "Formatted at 2026-08-06 02:19:59 on dist-test-slave-gkw7"
server_key: "37869f214353aae21d56bc1c3139b2c2"
server_key_iv: "314a0c82fae5f33eec11e55aa26c408c"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:59.325732 12193 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260806 02:19:59.348518 12216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:59.350531 12193 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260806 02:19:59.350780 12193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "5cabbfb55e194ac8965872bad139793d"
format_stamp: "Formatted at 2026-08-06 02:19:59 on dist-test-slave-gkw7"
server_key: "37869f214353aae21d56bc1c3139b2c2"
server_key_iv: "314a0c82fae5f33eec11e55aa26c408c"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:59.351059 12193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:19:59.380573 12193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:19:59.384598 12193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:19:59.384855 12193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:19:59.385669 12193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:19:59.386790 12193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:19:59.386895 12193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:59.387025 12193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:19:59.387132 12193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:59.397830 12193 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:36609
I20260806 02:19:59.397903 12372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:36609 every 8 connection(s)
I20260806 02:19:59.399160 12193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:19:59.408285 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 12193
I20260806 02:19:59.408425 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:19:59.408732 27382 external_mini_cluster.cc:1428] Setting key 1dacb50b697980c8377c96361b1398e8
Aug 06 02:19:59 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:19:59.417445 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:59.401623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:57277 (local address 127.26.189.190:43129)
0806 02:19:59.401949 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:59.401955 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:59.402866 (+ 911us) server_negotiation.cc:407] Connection header received
0806 02:19:59.404202 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:59.404207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:59.404267 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:59.404375 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:19:59.406106 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:59.406994 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:59.408752 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:59.409117 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:59.409196 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:59.412704 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:19:59.412709 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:19:59.412712 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:19:59.412739 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:19:59.414852 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:59.415515 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:59.415520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:59.415522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:59.415639 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:59.416065 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:59.416069 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:59.416072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:59.416312 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:19:59.416408 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:59.417110 (+ 702us) server_negotiation.cc:299] Negotiation successful
0806 02:19:59.417249 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":98,"threads_started":1}
I20260806 02:19:59.418731 12379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:59.402094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:43129 (local address 127.26.189.129:57277)
0806 02:19:59.402689 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0806 02:19:59.402749 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 02:19:59.403927 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:19:59.404651 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:19:59.404663 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:19:59.405093 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:19:59.405926 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:59.405978 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:59.407131 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:59.407135 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:59.408602 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:59.408614 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:59.409647 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:59.409652 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:59.409917 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:59.410653 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:19:59.410676 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:19:59.412475 (+ 1799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:19:59.414989 (+ 2514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:19:59.414996 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:19:59.415014 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:19:59.415372 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:19:59.415744 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:19:59.415747 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:19:59.415749 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:19:59.415946 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:19:59.416427 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:19:59.416434 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:19:59.416789 (+ 355us) client_negotiation.cc:769] Sending connection context
0806 02:19:59.417019 (+ 230us) client_negotiation.cc:240] Negotiation successful
0806 02:19:59.417381 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":143,"threads_started":1}
I20260806 02:19:59.420110 12373 heartbeater.cc:347] Connected to a master server at 127.26.189.190:43129
I20260806 02:19:59.420399 12373 heartbeater.cc:464] Registering TS with master...
I20260806 02:19:59.421022 12373 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
I20260806 02:19:59.423058 12069 ts_manager.cc:194] Registered new tserver with Master: 5cabbfb55e194ac8965872bad139793d (127.26.189.129:36609)
I20260806 02:19:59.424705 12069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:57277
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Aug 06 02:19:59 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785982799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:19:59.451006 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.189.148:50469/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:43129
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:19:59.620895 12384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:19:59.621292 12384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:19:59.621362 12384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:19:59.627674 12384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:19:59.627846 12384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:19:59.627975 12384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:19:59.636328 12384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.189.148:50469/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:43129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:19:59.638212 12384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:19:59.639626 12384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 02:19:59.652791 12384 server_base.cc:1034] running on GCE node
W20260806 02:19:59.652948 12395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:59.652642 12393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:19:59.653297 12392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:19:59.653893 12384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:19:59.654786 12384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:19:59.655998 12384 hybrid_clock.cc:648] HybridClock initialized: now 1785982799655969 us; error 50 us; skew 500 ppm
Aug 06 02:19:59 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:19:59.659968 12384 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:19:59.661198 12384 webserver.cc:460] Webserver started at http://127.26.189.130:34321/ using document root <none> and password file <none>
I20260806 02:19:59.662026 12384 fs_manager.cc:359] Metadata directory not provided
I20260806 02:19:59.662132 12384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:19:59.662462 12384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 02:19:59 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:19:59.678020 12384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "0664dd5ec0a54ad686a3766580eff361"
format_stamp: "Formatted at 2026-08-06 02:19:59 on dist-test-slave-gkw7"
server_key: "6b9a45774888d77b455d1ef5d570bc4f"
server_key_iv: "0b96f301758bdf6571ee3b657a1be14a"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:59.678812 12384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "0664dd5ec0a54ad686a3766580eff361"
format_stamp: "Formatted at 2026-08-06 02:19:59 on dist-test-slave-gkw7"
server_key: "6b9a45774888d77b455d1ef5d570bc4f"
server_key_iv: "0b96f301758bdf6571ee3b657a1be14a"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:59.685667 12384 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260806 02:19:59.717995 12404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:59.721233 12384 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.002s sys 0.000s
I20260806 02:19:59.721403 12384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "0664dd5ec0a54ad686a3766580eff361"
format_stamp: "Formatted at 2026-08-06 02:19:59 on dist-test-slave-gkw7"
server_key: "6b9a45774888d77b455d1ef5d570bc4f"
server_key_iv: "0b96f301758bdf6571ee3b657a1be14a"
server_key_version: "kuduclusterkey@0"
I20260806 02:19:59.721590 12384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:19:59.742760 12384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:19:59.746083 12384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:19:59.746309 12384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:19:59.746968 12384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:19:59.747960 12384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:19:59.748029 12384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:59.748131 12384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:19:59.748173 12384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:19:59.759857 12384 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:46055
I20260806 02:19:59.759878 12556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:46055 every 8 connection(s)
I20260806 02:19:59.761061 12384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:19:59.762776 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 12384
I20260806 02:19:59.762930 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:19:59.763265 27382 external_mini_cluster.cc:1428] Setting key 41b06f5d62a2fd516f7734dfff5a9665
Aug 06 02:19:59 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
I20260806 02:19:59.797574 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:59.764690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:33997 (local address 127.26.189.190:43129)
0806 02:19:59.764870 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 02:19:59.764874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:19:59.778922 (+ 14048us) server_negotiation.cc:407] Connection header received
0806 02:19:59.780831 (+ 1909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:19:59.780835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:19:59.780896 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:19:59.780953 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:19:59.782868 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:59.783724 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:59.788866 (+ 5142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:19:59.789297 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:19:59.789408 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:59.793064 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:19:59.793071 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:19:59.793077 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:19:59.793129 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:19:59.795012 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:59.795541 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:59.795544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:59.795546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:59.795632 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:19:59.796050 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:19:59.796054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:19:59.796055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:19:59.796252 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:19:59.796376 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 02:19:59.797113 (+ 737us) server_negotiation.cc:299] Negotiation successful
0806 02:19:59.797271 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260806 02:19:59.799613 12560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:19:59.763640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:43129 (local address 127.26.189.130:33997)
0806 02:19:59.778692 (+ 15052us) negotiation.cc:107] Waiting for socket to connect
0806 02:19:59.778773 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0806 02:19:59.780079 (+ 1306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:19:59.781513 (+ 1434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:19:59.781552 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:19:59.781980 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:19:59.782682 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:59.782703 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:59.783892 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:59.783895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:59.785369 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:19:59.785381 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:19:59.789712 (+ 4331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:19:59.789719 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:19:59.789988 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:19:59.790811 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:19:59.790841 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:19:59.792805 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:19:59.795134 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:19:59.795142 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:19:59.795161 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:19:59.795427 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:19:59.795723 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:19:59.795728 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:19:59.795730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:19:59.795928 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:19:59.796376 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:19:59.796384 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:19:59.796796 (+ 412us) client_negotiation.cc:769] Sending connection context
0806 02:19:59.798104 (+ 1308us) client_negotiation.cc:240] Negotiation successful
0806 02:19:59.798508 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14728,"thread_start_us":164,"threads_started":1}
I20260806 02:19:59.801282 12558 heartbeater.cc:347] Connected to a master server at 127.26.189.190:43129
I20260806 02:19:59.801568 12558 heartbeater.cc:464] Registering TS with master...
I20260806 02:19:59.802223 12558 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
I20260806 02:19:59.803462 12069 ts_manager.cc:194] Registered new tserver with Master: 0664dd5ec0a54ad686a3766580eff361 (127.26.189.130:46055)
I20260806 02:19:59.804189 12069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:33997
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:19:59.824568 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.189.148:50469/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:43129
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 02:19:59 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
W20260806 02:19:59.969218 12564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:19:59.969683 12564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:19:59.969802 12564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:19:59.975920 12564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:19:59.976069 12564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:19:59.976199 12564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:19:59.984050 12564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.189.148:50469/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:43129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:19:59.985702 12564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:19:59.987043 12564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:00.000041 12574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:00.000070 12572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:00.001103 12571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:00.001479 12564 server_base.cc:1034] running on GCE node
I20260806 02:20:00.002010 12564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:00.002799 12564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:00.003978 12564 hybrid_clock.cc:648] HybridClock initialized: now 1785982800003943 us; error 48 us; skew 500 ppm
Aug 06 02:20:00 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982800, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:00.007753 12564 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:20:00.008934 12564 webserver.cc:460] Webserver started at http://127.26.189.131:36333/ using document root <none> and password file <none>
I20260806 02:20:00.009713 12564 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:00.009816 12564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:00.010087 12564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 02:20:00 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982800, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:20:00.028316 12564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "9b23881c63dd42faade1dba7beea510f"
format_stamp: "Formatted at 2026-08-06 02:20:00 on dist-test-slave-gkw7"
server_key: "3e8c4a9cf58c5fa0033640957c179356"
server_key_iv: "eaa39f9ee697b41324c6bbbb4d1e47e4"
server_key_version: "kuduclusterkey@0"
I20260806 02:20:00.029452 12564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "9b23881c63dd42faade1dba7beea510f"
format_stamp: "Formatted at 2026-08-06 02:20:00 on dist-test-slave-gkw7"
server_key: "3e8c4a9cf58c5fa0033640957c179356"
server_key_iv: "eaa39f9ee697b41324c6bbbb4d1e47e4"
server_key_version: "kuduclusterkey@0"
I20260806 02:20:00.039192 12564 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.001s sys 0.003s
I20260806 02:20:00.065608 12585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:00.067610 12564 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.003s sys 0.001s
I20260806 02:20:00.067864 12564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "9b23881c63dd42faade1dba7beea510f"
format_stamp: "Formatted at 2026-08-06 02:20:00 on dist-test-slave-gkw7"
server_key: "3e8c4a9cf58c5fa0033640957c179356"
server_key_iv: "eaa39f9ee697b41324c6bbbb4d1e47e4"
server_key_version: "kuduclusterkey@0"
I20260806 02:20:00.068032 12564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:00.094501 12564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:00.098323 12564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:00.098521 12564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:00.099246 12564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:00.100282 12564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:00.100343 12564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:00.100396 12564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:00.100425 12564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:00.110911 12564 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:36707
I20260806 02:20:00.110989 12738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:36707 every 8 connection(s)
I20260806 02:20:00.112097 12564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:20:00.116506 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 12564
I20260806 02:20:00.116694 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:20:00.117034 27382 external_mini_cluster.cc:1428] Setting key 14a660b6dfa6758a291c6abf563db97c
Aug 06 02:20:00 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982800, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:00.129734 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:00.116275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:49005 (local address 127.26.189.190:43129)
0806 02:20:00.116410 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:00.116416 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:00.116437 (+ 21us) server_negotiation.cc:407] Connection header received
0806 02:20:00.117059 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:00.117064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:00.117122 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:00.117174 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:00.118926 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:00.119783 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:00.121490 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:00.121915 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:00.122036 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:00.124998 (+ 2962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:00.125002 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:00.125005 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:00.125034 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:00.126888 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:00.127644 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:00.127649 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:00.127651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:00.127748 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:00.128243 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:00.128247 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:00.128249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:00.128487 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:00.128655 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:00.129396 (+ 741us) server_negotiation.cc:299] Negotiation successful
0806 02:20:00.129554 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:20:00.131882 12744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:00.114982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:43129 (local address 127.26.189.131:49005)
0806 02:20:00.115625 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:00.115695 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:00.116771 (+ 1076us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:00.117646 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:00.117656 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:00.118057 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:00.118750 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:00.118769 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:00.119945 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:00.119948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:00.121345 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:00.121355 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:00.122081 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:00.122085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:00.122291 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:00.123025 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:00.123045 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:00.124818 (+ 1773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:00.127012 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:00.127020 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:00.127037 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:00.127397 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:00.127906 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:00.127912 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:00.127916 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:00.128112 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:00.128755 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:00.128762 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:00.129093 (+ 331us) client_negotiation.cc:769] Sending connection context
0806 02:20:00.129334 (+ 241us) client_negotiation.cc:240] Negotiation successful
0806 02:20:00.130759 (+ 1425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":189,"threads_started":1}
I20260806 02:20:00.133059 12740 heartbeater.cc:347] Connected to a master server at 127.26.189.190:43129
I20260806 02:20:00.133327 12740 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:00.133965 12740 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
I20260806 02:20:00.135077 12069 ts_manager.cc:194] Registered new tserver with Master: 9b23881c63dd42faade1dba7beea510f (127.26.189.131:36707)
I20260806 02:20:00.135812 12069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:49005
I20260806 02:20:00.143021 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:20:00.143883 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 12193
I20260806 02:20:00.178540 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 12384
I20260806 02:20:00.196260 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 12564
I20260806 02:20:00.212170 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 12026
I20260806 02:20:00.236505 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:43129
--webserver_interface=127.26.189.190
--webserver_port=45183
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:43129
--ranger_config_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.189.148:50469/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.189.148:50469/kms with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:00.351316 12745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:00.351596 12745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:00.351634 12745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:00.355711 12745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:20:00.355777 12745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:00.355796 12745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:00.355813 12745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:20:00.355829 12745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:20:00.361395 12745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.189.148:50469/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:43129
--ranger_config_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:43129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=45183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:00.362497 12745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:00.363598 12745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:00.372453 12758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:00.372422 12757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:00.372478 12745 server_base.cc:1034] running on GCE node
W20260806 02:20:00.372430 12761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:00.373317 12745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:00.374470 12745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:00.375651 12745 hybrid_clock.cc:648] HybridClock initialized: now 1785982800375624 us; error 51 us; skew 500 ppm
Aug 06 02:20:00 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982800, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:00.378520 12745 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:20:00.379446 12745 webserver.cc:460] Webserver started at http://127.26.189.190:45183/ using document root <none> and password file <none>
I20260806 02:20:00.379992 12745 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:00.380087 12745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 02:20:00 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982800, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:20:00.433725 12745 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:00.436193 12772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:00.437695 12745 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:00.437834 12745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "2cc0e7b7a6df41b5a1433ec15365c47c"
format_stamp: "Formatted at 2026-08-06 02:19:58 on dist-test-slave-gkw7"
server_key: "a0758ab8aed97d083967ed181430b702"
server_key_iv: "f5d107790c3b52d6ea254b9e7a053a4c"
server_key_version: "kuduclusterkey@0"
I20260806 02:20:00.438409 12745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:00.468840 12745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:00.472107 12745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:00.472325 12745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:00.480131 12745 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:43129
I20260806 02:20:00.480134 12838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:43129 every 8 connection(s)
I20260806 02:20:00.481300 12745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:20:00.484807 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 12745
I20260806 02:20:00.485311 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.189.148:50469/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:36609
--local_ip_for_outbound_sockets=127.26.189.129
--tserver_master_addrs=127.26.189.190:43129
--webserver_port=33009
--webserver_interface=127.26.189.129
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.189.148:50469/kms with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:20:00.485832 12840 sys_catalog.cc:263] Verifying existing consensus state
I20260806 02:20:00.487498 12840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c: Bootstrap starting.
I20260806 02:20:00.504526 12840 log.cc:824] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:00.511327 12840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 02:20:00.511731 12840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c: Bootstrap complete.
I20260806 02:20:00.515938 12840 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43129 } }
I20260806 02:20:00.516373 12840 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cc0e7b7a6df41b5a1433ec15365c47c, State: Initialized, Role: FOLLOWER
I20260806 02:20:00.516862 12840 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43129 } }
I20260806 02:20:00.517005 12840 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:20:00.517099 12840 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:20:00.517210 12840 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 1 FOLLOWER]: Advancing to term 2
I20260806 02:20:00.519181 12840 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43129 } }
I20260806 02:20:00.519541 12840 leader_election.cc:302] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2cc0e7b7a6df41b5a1433ec15365c47c; no voters:
I20260806 02:20:00.519876 12840 leader_election.cc:288] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 02:20:00.519966 12844 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 2 FOLLOWER]: Leader election won for term 2
I20260806 02:20:00.520198 12844 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [term 2 LEADER]: Becoming Leader. State: Replica: 2cc0e7b7a6df41b5a1433ec15365c47c, State: Running, Role: LEADER
I20260806 02:20:00.520486 12844 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43129 } }
I20260806 02:20:00.521178 12840 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:20:00.521498 12845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43129 } } }
I20260806 02:20:00.521669 12845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:00.521926 12847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2cc0e7b7a6df41b5a1433ec15365c47c. Latest consensus state: current_term: 2 leader_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc0e7b7a6df41b5a1433ec15365c47c" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43129 } } }
I20260806 02:20:00.522043 12847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:00.522362 12852 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:20:00.525667 12852 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:20:00.526183 12840 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 02:20:00.526376 12852 catalog_manager.cc:1259] Loaded cluster ID: 8932190d1ede401886727db113ebd359
I20260806 02:20:00.526430 12852 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:20:00.534729 12852 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:20:00.535748 12852 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c: Loaded TSK: 0
I20260806 02:20:00.537055 12852 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 02:20:00.609905 12842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:00.610189 12842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:00.610268 12842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:00.614495 12842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:00.614580 12842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:00.614684 12842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:20:00.620935 12842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.189.148:50469/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:36609
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=33009
--tserver_master_addrs=127.26.189.190:43129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:00.622309 12842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:00.623456 12842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:00.636512 12894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:00.636826 12842 server_base.cc:1034] running on GCE node
W20260806 02:20:00.637979 12891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:00.637984 12890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:00.638587 12842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:00.639361 12842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:00.642659 12842 hybrid_clock.cc:648] HybridClock initialized: now 1785982800642621 us; error 58 us; skew 500 ppm
Aug 06 02:20:00 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982800, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:00.646214 12842 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:20:00.647229 12842 webserver.cc:460] Webserver started at http://127.26.189.129:33009/ using document root <none> and password file <none>
I20260806 02:20:00.647816 12842 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:00.647927 12842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 02:20:00 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982800, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:20:00.673512 12842 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 02:20:00.676342 12906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:00.677775 12842 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 02:20:00.677917 12842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "5cabbfb55e194ac8965872bad139793d"
format_stamp: "Formatted at 2026-08-06 02:19:59 on dist-test-slave-gkw7"
server_key: "37869f214353aae21d56bc1c3139b2c2"
server_key_iv: "314a0c82fae5f33eec11e55aa26c408c"
server_key_version: "kuduclusterkey@0"
I20260806 02:20:00.679358 12842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:00.705271 12842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:00.708586 12842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:00.708815 12842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:00.709671 12842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:00.710742 12842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:00.710815 12842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:00.710884 12842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:00.710909 12842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:00.722479 12842 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:36609
I20260806 02:20:00.722503 13057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:36609 every 8 connection(s)
I20260806 02:20:00.723712 12842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:20:00.725227 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 12842
I20260806 02:20:00.725782 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.189.148:50469/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:46055
--local_ip_for_outbound_sockets=127.26.189.130
--tserver_master_addrs=127.26.189.190:43129
--webserver_port=34321
--webserver_interface=127.26.189.130
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.189.148:50469/kms with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 02:20:00 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982800, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:00.760809 13062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:00.727227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:43129 (local address 127.26.189.129:46375)
0806 02:20:00.732037 (+ 4810us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:00.732102 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:00.733241 (+ 1139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:00.736953 (+ 3712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:00.736962 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:00.737340 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:00.738016 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:00.738041 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:00.740048 (+ 2007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:00.740055 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:00.741845 (+ 1790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:00.741861 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:00.743232 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:00.743239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:00.743613 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:00.744417 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:00.744442 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:00.746456 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:00.756681 (+ 10225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:00.756689 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:00.756705 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:00.757105 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:00.757624 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:00.757628 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:00.757630 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:00.757839 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:00.758695 (+ 856us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:00.758702 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:00.759031 (+ 329us) client_negotiation.cc:769] Sending connection context
0806 02:20:00.759231 (+ 200us) client_negotiation.cc:240] Negotiation successful
0806 02:20:00.759640 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4553,"thread_start_us":148,"threads_started":1}
I20260806 02:20:00.763177 13064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:00.728782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:46375 (local address 127.26.189.190:43129)
0806 02:20:00.735743 (+ 6961us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:00.735767 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:00.735821 (+ 54us) server_negotiation.cc:407] Connection header received
0806 02:20:00.736154 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:00.736177 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:00.736511 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:00.736878 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:00.738254 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:00.739865 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:00.742026 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:00.743012 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:00.744065 (+ 1053us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:00.754101 (+ 10036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:00.754109 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:00.754131 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:00.754173 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:00.756476 (+ 2303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:00.757286 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:00.757294 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:00.757301 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:00.757453 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:00.757977 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:00.757983 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:00.757985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:00.758532 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:00.761691 (+ 3159us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:00.761893 (+ 202us) server_negotiation.cc:299] Negotiation successful
0806 02:20:00.762189 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6763,"thread_start_us":102,"threads_started":1}
I20260806 02:20:00.766023 13059 heartbeater.cc:347] Connected to a master server at 127.26.189.190:43129
I20260806 02:20:00.766319 13059 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:00.766925 13059 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
W20260806 02:20:00.769410 13059 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:43129 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 02:20:00.769606 13059 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:00.769830 13059 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
I20260806 02:20:00.770757 13059 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:00.770969 13059 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
W20260806 02:20:00.771770 13059 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 02:20:00.886883 13063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:00.887184 13063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:00.887316 13063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:00.891712 13063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:00.891788 13063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:00.891896 13063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:20:00.898020 13063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.189.148:50469/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:46055
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=34321
--tserver_master_addrs=127.26.189.190:43129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:00.899240 13063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:00.900429 13063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:00.911736 13071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:00.911943 13073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:00.912350 13063 server_base.cc:1034] running on GCE node
W20260806 02:20:00.912371 13070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:00.913075 13063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:00.913995 13063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:00.915225 13063 hybrid_clock.cc:648] HybridClock initialized: now 1785982800915197 us; error 46 us; skew 500 ppm
Aug 06 02:20:00 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982800, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:00.919000 13063 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:20:00.920135 13063 webserver.cc:460] Webserver started at http://127.26.189.130:34321/ using document root <none> and password file <none>
I20260806 02:20:00.920938 13063 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:00.921046 13063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 02:20:00 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982800, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:20:00.941747 13063 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:20:00.945286 13082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:00.946697 13063 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 02:20:00.946805 13063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "0664dd5ec0a54ad686a3766580eff361"
format_stamp: "Formatted at 2026-08-06 02:19:59 on dist-test-slave-gkw7"
server_key: "6b9a45774888d77b455d1ef5d570bc4f"
server_key_iv: "0b96f301758bdf6571ee3b657a1be14a"
server_key_version: "kuduclusterkey@0"
I20260806 02:20:00.947398 13063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:00.960896 13063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:00.964574 13063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:00.964790 13063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:00.965579 13063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:00.966638 13063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:00.966706 13063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:00.966780 13063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:00.966813 13063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:00.978385 13063 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:46055
I20260806 02:20:00.978629 13234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:46055 every 8 connection(s)
I20260806 02:20:00.979507 13063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:20:00.984149 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 13063
I20260806 02:20:00.984709 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.189.148:50469/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:36707
--local_ip_for_outbound_sockets=127.26.189.131
--tserver_master_addrs=127.26.189.190:43129
--webserver_port=36333
--webserver_interface=127.26.189.131
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.189.148:50469/kms with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 02:20:00 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982800, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:01.001391 13064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:00.983958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:39367 (local address 127.26.189.190:43129)
0806 02:20:00.984104 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:00.984108 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:00.987202 (+ 3094us) server_negotiation.cc:407] Connection header received
0806 02:20:00.988229 (+ 1027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:00.988232 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:00.988297 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:00.988390 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:00.990350 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:00.991226 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:00.993009 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:00.993386 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:00.993472 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:00.996787 (+ 3315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:00.996794 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:00.996800 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:00.996835 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:00.998712 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:00.999384 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:00.999387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:00.999389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:00.999487 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:00.999947 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:00.999951 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:00.999953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:01.000202 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:01.000297 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:01.001038 (+ 741us) server_negotiation.cc:299] Negotiation successful
0806 02:20:01.001198 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 02:20:01.003443 13237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:00.982168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:43129 (local address 127.26.189.130:39367)
0806 02:20:00.987006 (+ 4838us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:00.987057 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:00.987966 (+ 909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:00.988981 (+ 1015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:00.988991 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:00.989399 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:00.990130 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:00.990151 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:00.991397 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:00.991400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:00.992856 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:00.992868 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:00.993738 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:00.993742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:00.993945 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:00.994678 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:00.994698 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:00.996558 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:00.998863 (+ 2305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:00.998869 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:00.998887 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:00.999258 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:00.999605 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:00.999611 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:00.999616 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:00.999825 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:01.000369 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:01.000376 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:01.000730 (+ 354us) client_negotiation.cc:769] Sending connection context
0806 02:20:01.001894 (+ 1164us) client_negotiation.cc:240] Negotiation successful
0806 02:20:01.002280 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4627,"thread_start_us":133,"threads_started":1}
I20260806 02:20:01.005048 13235 heartbeater.cc:347] Connected to a master server at 127.26.189.190:43129
I20260806 02:20:01.005349 13235 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:01.005991 13235 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
W20260806 02:20:01.007853 13235 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:43129 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 02:20:01.007974 13235 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:01.008129 13235 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
I20260806 02:20:01.009124 13235 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:01.009295 13235 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
W20260806 02:20:01.010294 13235 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 02:20:01.155169 13238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:01.155608 13238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:01.155707 13238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:01.161937 13238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:01.162029 13238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:01.162119 13238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:20:01.170313 13238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.189.148:50469/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:36707
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=36333
--tserver_master_addrs=127.26.189.190:43129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:01.171825 13238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:01.173266 13238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:01.186897 13247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:01.187093 13246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:01.186904 13249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:01.186957 13238 server_base.cc:1034] running on GCE node
I20260806 02:20:01.187609 13238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:01.188292 13238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:01.189488 13238 hybrid_clock.cc:648] HybridClock initialized: now 1785982801189461 us; error 49 us; skew 500 ppm
Aug 06 02:20:01 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982801, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:01.192409 13238 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:20:01.193323 13238 webserver.cc:460] Webserver started at http://127.26.189.131:36333/ using document root <none> and password file <none>
I20260806 02:20:01.193971 13238 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:01.194048 13238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 02:20:01 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982801, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:20:01.214811 13238 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 02:20:01.219272 13260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:01.221321 13238 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260806 02:20:01.221520 13238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "9b23881c63dd42faade1dba7beea510f"
format_stamp: "Formatted at 2026-08-06 02:20:00 on dist-test-slave-gkw7"
server_key: "3e8c4a9cf58c5fa0033640957c179356"
server_key_iv: "eaa39f9ee697b41324c6bbbb4d1e47e4"
server_key_version: "kuduclusterkey@0"
I20260806 02:20:01.222538 13238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:01.254482 13238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:01.258462 13238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:01.258698 13238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:01.259420 13238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:01.260372 13238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:01.260440 13238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:01.260505 13238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:01.260537 13238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:01.274763 13238 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:36707
I20260806 02:20:01.274837 13413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:36707 every 8 connection(s)
I20260806 02:20:01.276252 13238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:20:01.278782 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 13238
Aug 06 02:20:01 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982801, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:01.291348 13064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:01.280728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38826 (local address 127.26.189.190:43129)
0806 02:20:01.280850 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:01.280855 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:01.280871 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:20:01.280919 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:01.280924 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:01.280980 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:01.281062 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:01.282249 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:01.283025 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:01.284344 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:01.284675 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:01.284766 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:01.286830 (+ 2064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:01.286834 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:01.286836 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:01.286864 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:01.288755 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:01.290028 (+ 1273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:01.290034 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:01.290039 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:01.290138 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:01.290434 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:01.290437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:01.290439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:01.290617 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:01.290830 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:01.291024 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 02:20:01.291152 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 02:20:01.297029 13419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:01.281705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:49953 (local address 127.26.189.190:43129)
0806 02:20:01.283752 (+ 2047us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:01.283756 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:01.283771 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:20:01.284406 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:01.284410 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:01.284461 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:01.284545 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:01.285891 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:01.286564 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:01.288319 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:01.288604 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:01.288722 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:01.291781 (+ 3059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:01.291784 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:01.291786 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:01.291826 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:01.293633 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:01.294280 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:01.294284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:01.294285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:01.294375 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:01.295805 (+ 1430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:01.295808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:01.295810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:01.295985 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:01.296104 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:01.296706 (+ 602us) server_negotiation.cc:299] Negotiation successful
0806 02:20:01.296842 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1970,"thread_start_us":86,"threads_started":1}
I20260806 02:20:01.297936 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:01.281387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:43129 (local address 127.26.189.131:49953)
0806 02:20:01.282932 (+ 1545us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:01.282986 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:01.284036 (+ 1050us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:01.284831 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:01.284840 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:01.285174 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:01.285744 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:01.285761 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:01.286686 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:01.286693 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:01.288159 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:01.288171 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:01.288775 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:01.288779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:01.288959 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:01.289469 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:01.289485 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:01.291599 (+ 2114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:01.293770 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:01.293776 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:01.293793 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:01.294135 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:01.294488 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:01.294491 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:01.294493 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:01.294664 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:01.296103 (+ 1439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:01.296110 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:01.296384 (+ 274us) client_negotiation.cc:769] Sending connection context
0806 02:20:01.296615 (+ 231us) client_negotiation.cc:240] Negotiation successful
0806 02:20:01.296963 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1332,"thread_start_us":488,"threads_started":1}
I20260806 02:20:01.299326 13415 heartbeater.cc:347] Connected to a master server at 127.26.189.190:43129
I20260806 02:20:01.299592 13415 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:01.300186 13415 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
W20260806 02:20:01.301949 13415 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:43129 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 02:20:01.302069 13415 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:01.302224 13415 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
I20260806 02:20:01.302989 13415 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:01.303161 13415 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
W20260806 02:20:01.304006 13415 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 02:20:01 dist-test-slave-gkw7 krb5kdc[11414](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785982801, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:01.772014 13059 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:01.772338 13059 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
I20260806 02:20:01.773795 12790 ts_manager.cc:194] Registered new tserver with Master: 5cabbfb55e194ac8965872bad139793d (127.26.189.129:36609)
I20260806 02:20:01.775542 12790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:46375
I20260806 02:20:02.010586 13235 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:02.010959 13235 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
I20260806 02:20:02.011940 12790 ts_manager.cc:194] Registered new tserver with Master: 0664dd5ec0a54ad686a3766580eff361 (127.26.189.130:46055)
I20260806 02:20:02.012795 12790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:39367
Aug 06 02:20:02 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982801, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:20:02.304219 13415 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:02.304555 13415 heartbeater.cc:511] Master 127.26.189.190:43129 requested a full tablet report, sending...
I20260806 02:20:02.305471 12790 ts_manager.cc:194] Registered new tserver with Master: 9b23881c63dd42faade1dba7beea510f (127.26.189.131:36707)
I20260806 02:20:02.306329 12790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:49953
I20260806 02:20:02.310065 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:20:02.322901 13444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.312044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38828 (local address 127.26.189.190:43129)
0806 02:20:02.312312 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:02.312317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:02.312882 (+ 565us) server_negotiation.cc:407] Connection header received
0806 02:20:02.312997 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:02.313001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:02.313053 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:02.313146 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:02.313991 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.314820 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.315994 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.316330 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.316422 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.318719 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:02.318723 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:02.318726 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:02.318755 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:02.320608 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:02.321100 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:02.321104 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:02.321106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:02.321199 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:02.321616 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:02.321620 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:02.321622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:02.321863 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:02.321985 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:02.322590 (+ 605us) server_negotiation.cc:299] Negotiation successful
0806 02:20:02.322722 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":98,"threads_started":1}
Aug 06 02:20:02 dist-test-slave-gkw7 krb5kdc[11414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982801, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for HTTP/127.26.189.148@KRBTEST.COM
I20260806 02:20:02.331887 12790 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38828:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:20:02.337123 12790 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:20:02.372277 13457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.356732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:36609 (local address 127.0.0.1:53424)
0806 02:20:02.359494 (+ 2762us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:02.359539 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:02.359653 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:02.360813 (+ 1160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:02.360821 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:02.360853 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:02.361022 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.361031 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.367808 (+ 6777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.367812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.368856 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.368867 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.371612 (+ 2745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.371616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.371747 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.371806 (+ 59us) client_negotiation.cc:769] Sending connection context
0806 02:20:02.371919 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 02:20:02.372055 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2595,"thread_start_us":170,"threads_started":1}
I20260806 02:20:02.373971 13454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.357737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53424 (local address 127.26.189.129:36609)
0806 02:20:02.359899 (+ 2162us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:02.359906 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:02.359925 (+ 19us) server_negotiation.cc:407] Connection header received
0806 02:20:02.359988 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:02.359992 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:02.360262 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:02.360420 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:02.361243 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.367649 (+ 6406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.370245 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.371120 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.371250 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.373605 (+ 2355us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:02.373681 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 02:20:02.373811 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2063,"thread_start_us":91,"threads_started":1}
I20260806 02:20:02.377570 12949 tablet_service.cc:1467] Processing CreateTablet for tablet 526c1fcaae6f42bb8287cc195b2be75b (DEFAULT_TABLE table=test-table [id=1f8216d384d84ce196dc04495469136d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:02.378885 12949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 526c1fcaae6f42bb8287cc195b2be75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:02.388901 13450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.356847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:36707 (local address 127.0.0.1:49692)
0806 02:20:02.361862 (+ 5015us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:02.361878 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:02.361984 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:02.364026 (+ 2042us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:02.364030 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:02.364081 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:02.364188 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.364195 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.365609 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.365613 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.367104 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.367117 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.372869 (+ 5752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.372873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.372968 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.372994 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 02:20:02.388592 (+ 15598us) client_negotiation.cc:240] Negotiation successful
0806 02:20:02.388713 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4929,"thread_start_us":90,"threads_started":1}
I20260806 02:20:02.390360 13456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.358134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49692 (local address 127.26.189.131:36707)
0806 02:20:02.360718 (+ 2584us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:02.360725 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:02.362085 (+ 1360us) server_negotiation.cc:407] Connection header received
0806 02:20:02.362319 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:02.362325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:02.362540 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:02.362704 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:02.364342 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.365445 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.369001 (+ 3556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.369880 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.370016 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.370171 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:02.390032 (+ 19861us) server_negotiation.cc:299] Negotiation successful
0806 02:20:02.390192 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2472,"thread_start_us":107,"threads_started":1}
I20260806 02:20:02.397454 13330 tablet_service.cc:1467] Processing CreateTablet for tablet 526c1fcaae6f42bb8287cc195b2be75b (DEFAULT_TABLE table=test-table [id=1f8216d384d84ce196dc04495469136d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:02.398732 13330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 526c1fcaae6f42bb8287cc195b2be75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:02.408144 13451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.358827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:46055 (local address 127.0.0.1:40542)
0806 02:20:02.363000 (+ 4173us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:02.363015 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:02.363106 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:02.403249 (+ 40143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:02.403253 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:02.403282 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:02.403432 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.403440 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.405108 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.405112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.406373 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.406386 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.407648 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.407652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.407796 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.407830 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 02:20:02.407891 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 02:20:02.407976 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4105,"thread_start_us":133,"threads_started":1}
I20260806 02:20:02.408964 13458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.359018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40542 (local address 127.26.189.130:46055)
0806 02:20:02.398953 (+ 39935us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:02.398961 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:02.398989 (+ 28us) server_negotiation.cc:407] Connection header received
0806 02:20:02.399073 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:02.399078 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:02.399308 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:02.403621 (+ 4313us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:02.403802 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.404949 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.406551 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.407404 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.408513 (+ 1109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.408653 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:02.408706 (+ 53us) server_negotiation.cc:299] Negotiation successful
0806 02:20:02.408815 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39801,"thread_start_us":65,"threads_started":1}
I20260806 02:20:02.412207 13120 tablet_service.cc:1467] Processing CreateTablet for tablet 526c1fcaae6f42bb8287cc195b2be75b (DEFAULT_TABLE table=test-table [id=1f8216d384d84ce196dc04495469136d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:02.413426 13120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 526c1fcaae6f42bb8287cc195b2be75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:02.413861 13463 tablet_bootstrap.cc:492] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d: Bootstrap starting.
I20260806 02:20:02.424463 13465 tablet_bootstrap.cc:492] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361: Bootstrap starting.
I20260806 02:20:02.427142 13465 tablet_bootstrap.cc:654] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:02.428534 13465 log.cc:824] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:02.431331 13463 tablet_bootstrap.cc:654] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:02.431933 13465 tablet_bootstrap.cc:492] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361: No bootstrap required, opened a new log
I20260806 02:20:02.432193 13465 ts_tablet_manager.cc:1397] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260806 02:20:02.435911 13463 log.cc:824] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:02.436702 13465 raft_consensus.cc:348] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cabbfb55e194ac8965872bad139793d" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36609 } } peers { permanent_uuid: "9b23881c63dd42faade1dba7beea510f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 36707 } } peers { permanent_uuid: "0664dd5ec0a54ad686a3766580eff361" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 46055 } }
I20260806 02:20:02.437031 13465 raft_consensus.cc:374] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:02.437099 13465 raft_consensus.cc:729] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0664dd5ec0a54ad686a3766580eff361, State: Initialized, Role: FOLLOWER
I20260806 02:20:02.437943 13465 consensus_queue.cc:260] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cabbfb55e194ac8965872bad139793d" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36609 } } peers { permanent_uuid: "9b23881c63dd42faade1dba7beea510f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 36707 } } peers { permanent_uuid: "0664dd5ec0a54ad686a3766580eff361" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 46055 } }
I20260806 02:20:02.439215 13465 ts_tablet_manager.cc:1428] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 02:20:02.439675 13235 heartbeater.cc:503] Master 127.26.189.190:43129 was elected leader, sending a full tablet report...
I20260806 02:20:02.452028 13464 tablet_bootstrap.cc:492] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f: Bootstrap starting.
I20260806 02:20:02.452755 13463 tablet_bootstrap.cc:492] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d: No bootstrap required, opened a new log
I20260806 02:20:02.453104 13463 ts_tablet_manager.cc:1397] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d: Time spent bootstrapping tablet: real 0.039s user 0.007s sys 0.000s
I20260806 02:20:02.454947 13464 tablet_bootstrap.cc:654] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:02.455920 13464 log.cc:824] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:02.458901 13463 raft_consensus.cc:348] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cabbfb55e194ac8965872bad139793d" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36609 } } peers { permanent_uuid: "9b23881c63dd42faade1dba7beea510f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 36707 } } peers { permanent_uuid: "0664dd5ec0a54ad686a3766580eff361" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 46055 } }
I20260806 02:20:02.465142 13463 raft_consensus.cc:374] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:02.465286 13463 raft_consensus.cc:729] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cabbfb55e194ac8965872bad139793d, State: Initialized, Role: FOLLOWER
I20260806 02:20:02.466032 13463 consensus_queue.cc:260] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cabbfb55e194ac8965872bad139793d" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36609 } } peers { permanent_uuid: "9b23881c63dd42faade1dba7beea510f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 36707 } } peers { permanent_uuid: "0664dd5ec0a54ad686a3766580eff361" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 46055 } }
I20260806 02:20:02.467391 13463 ts_tablet_manager.cc:1428] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260806 02:20:02.467824 13059 heartbeater.cc:503] Master 127.26.189.190:43129 was elected leader, sending a full tablet report...
I20260806 02:20:02.468550 13464 tablet_bootstrap.cc:492] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f: No bootstrap required, opened a new log
I20260806 02:20:02.468813 13464 ts_tablet_manager.cc:1397] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260806 02:20:02.473078 13464 raft_consensus.cc:348] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cabbfb55e194ac8965872bad139793d" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36609 } } peers { permanent_uuid: "9b23881c63dd42faade1dba7beea510f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 36707 } } peers { permanent_uuid: "0664dd5ec0a54ad686a3766580eff361" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 46055 } }
I20260806 02:20:02.473404 13464 raft_consensus.cc:374] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:02.473465 13464 raft_consensus.cc:729] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b23881c63dd42faade1dba7beea510f, State: Initialized, Role: FOLLOWER
W20260806 02:20:02.477705 13060 tablet.cc:2369] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 02:20:02.481583 13236 tablet.cc:2369] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:20:02.485955 13464 consensus_queue.cc:260] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cabbfb55e194ac8965872bad139793d" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36609 } } peers { permanent_uuid: "9b23881c63dd42faade1dba7beea510f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 36707 } } peers { permanent_uuid: "0664dd5ec0a54ad686a3766580eff361" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 46055 } }
I20260806 02:20:02.487497 13464 ts_tablet_manager.cc:1428] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f: Time spent starting tablet: real 0.019s user 0.008s sys 0.000s
I20260806 02:20:02.487954 13415 heartbeater.cc:503] Master 127.26.189.190:43129 was elected leader, sending a full tablet report...
W20260806 02:20:02.528815 13416 tablet.cc:2369] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:20:02.623066 13473 raft_consensus.cc:482] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:02.623318 13473 raft_consensus.cc:504] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cabbfb55e194ac8965872bad139793d" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36609 } } peers { permanent_uuid: "9b23881c63dd42faade1dba7beea510f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 36707 } } peers { permanent_uuid: "0664dd5ec0a54ad686a3766580eff361" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 46055 } }
I20260806 02:20:02.624523 13473 leader_election.cc:288] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cabbfb55e194ac8965872bad139793d (127.26.189.129:36609), 0664dd5ec0a54ad686a3766580eff361 (127.26.189.130:46055)
I20260806 02:20:02.627529 13472 raft_consensus.cc:482] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:02.627722 13472 raft_consensus.cc:504] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cabbfb55e194ac8965872bad139793d" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36609 } } peers { permanent_uuid: "9b23881c63dd42faade1dba7beea510f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 36707 } } peers { permanent_uuid: "0664dd5ec0a54ad686a3766580eff361" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 46055 } }
I20260806 02:20:02.628954 13472 leader_election.cc:288] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b23881c63dd42faade1dba7beea510f (127.26.189.131:36707), 0664dd5ec0a54ad686a3766580eff361 (127.26.189.130:46055)
I20260806 02:20:02.629041 13454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.624977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:44887 (local address 127.26.189.129:36609)
0806 02:20:02.625115 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:02.625120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:02.625454 (+ 334us) server_negotiation.cc:407] Connection header received
0806 02:20:02.625648 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:02.625651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:02.625693 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:02.625775 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:02.626103 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.626648 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.627968 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.628451 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.628574 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.628627 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:02.628805 (+ 178us) server_negotiation.cc:299] Negotiation successful
0806 02:20:02.628894 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 02:20:02.629055 13486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.624814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:36609 (local address 127.26.189.131:44887)
0806 02:20:02.625358 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:02.625370 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:02.625496 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:02.625797 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:02.625800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:02.625828 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:02.625991 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.625997 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.626775 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.626778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.627855 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.627866 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.628569 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.628573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.628674 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.628696 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 02:20:02.628791 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 02:20:02.628861 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"mutex_wait_us":106,"spinlock_wait_cycles":19712,"thread_start_us":105,"threads_started":1}
I20260806 02:20:02.629819 12992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "526c1fcaae6f42bb8287cc195b2be75b" candidate_uuid: "9b23881c63dd42faade1dba7beea510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cabbfb55e194ac8965872bad139793d" is_pre_election: true
I20260806 02:20:02.630057 12992 raft_consensus.cc:2454] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b23881c63dd42faade1dba7beea510f in term 0.
I20260806 02:20:02.630133 13458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.624944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:53771 (local address 127.26.189.130:46055)
0806 02:20:02.625087 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:02.625092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:02.625374 (+ 282us) server_negotiation.cc:407] Connection header received
0806 02:20:02.625586 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:02.625591 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:02.625652 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:02.625744 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:02.626038 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.626575 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.628427 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.629022 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.629149 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.629226 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:02.629950 (+ 724us) server_negotiation.cc:299] Negotiation successful
0806 02:20:02.630044 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 02:20:02.630532 13487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.624814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:46055 (local address 127.26.189.131:53771)
0806 02:20:02.625265 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:02.625278 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:02.625425 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:02.625754 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:02.625757 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:02.625772 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:02.625925 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.625931 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.626692 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.626698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.627853 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.627866 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.629672 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.629678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.629791 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.629818 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 02:20:02.630282 (+ 464us) client_negotiation.cc:240] Negotiation successful
0806 02:20:02.630381 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":56,"thread_start_us":179,"threads_started":1}
I20260806 02:20:02.630676 13264 leader_election.cc:302] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cabbfb55e194ac8965872bad139793d, 9b23881c63dd42faade1dba7beea510f; no voters:
I20260806 02:20:02.630973 13473 raft_consensus.cc:2781] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:20:02.631073 13473 raft_consensus.cc:482] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:20:02.631070 13168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "526c1fcaae6f42bb8287cc195b2be75b" candidate_uuid: "9b23881c63dd42faade1dba7beea510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0664dd5ec0a54ad686a3766580eff361" is_pre_election: true
I20260806 02:20:02.631145 13473 raft_consensus.cc:3037] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:02.631325 13168 raft_consensus.cc:2454] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b23881c63dd42faade1dba7beea510f in term 0.
I20260806 02:20:02.632468 13473 raft_consensus.cc:504] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cabbfb55e194ac8965872bad139793d" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36609 } } peers { permanent_uuid: "9b23881c63dd42faade1dba7beea510f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 36707 } } peers { permanent_uuid: "0664dd5ec0a54ad686a3766580eff361" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 46055 } }
I20260806 02:20:02.632843 13473 leader_election.cc:288] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [CANDIDATE]: Term 1 election: Requested vote from peers 5cabbfb55e194ac8965872bad139793d (127.26.189.129:36609), 0664dd5ec0a54ad686a3766580eff361 (127.26.189.130:46055)
I20260806 02:20:02.633271 13168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "526c1fcaae6f42bb8287cc195b2be75b" candidate_uuid: "9b23881c63dd42faade1dba7beea510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0664dd5ec0a54ad686a3766580eff361"
I20260806 02:20:02.633365 12992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "526c1fcaae6f42bb8287cc195b2be75b" candidate_uuid: "9b23881c63dd42faade1dba7beea510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cabbfb55e194ac8965872bad139793d"
I20260806 02:20:02.633391 13168 raft_consensus.cc:3037] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:02.633491 12992 raft_consensus.cc:3037] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:02.634243 13490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.629300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:46055 (local address 127.26.189.129:48439)
0806 02:20:02.629805 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:02.629820 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:02.629914 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:02.630393 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:02.630396 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:02.630415 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:02.630552 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.630559 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.631547 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.631554 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.632770 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.632784 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.633813 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.633817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.633919 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.633940 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 02:20:02.634021 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 02:20:02.634085 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":150,"threads_started":1}
I20260806 02:20:02.634445 13491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.629750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:48439 (local address 127.26.189.130:46055)
0806 02:20:02.630156 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:02.630166 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:02.630179 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:20:02.630220 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:02.630224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:02.630273 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:02.630361 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:02.630695 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.631418 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.632871 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.633535 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.633685 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.633734 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:02.634055 (+ 321us) server_negotiation.cc:299] Negotiation successful
0806 02:20:02.634153 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":136,"threads_started":1}
I20260806 02:20:02.634739 12992 raft_consensus.cc:2454] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b23881c63dd42faade1dba7beea510f in term 1.
I20260806 02:20:02.634758 13168 raft_consensus.cc:2454] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b23881c63dd42faade1dba7beea510f in term 1.
I20260806 02:20:02.635023 13264 leader_election.cc:302] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cabbfb55e194ac8965872bad139793d, 9b23881c63dd42faade1dba7beea510f; no voters:
I20260806 02:20:02.635236 13473 raft_consensus.cc:2781] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:20:02.635336 13168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "526c1fcaae6f42bb8287cc195b2be75b" candidate_uuid: "5cabbfb55e194ac8965872bad139793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0664dd5ec0a54ad686a3766580eff361" is_pre_election: true
I20260806 02:20:02.635442 13473 raft_consensus.cc:686] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 1 LEADER]: Becoming Leader. State: Replica: 9b23881c63dd42faade1dba7beea510f, State: Running, Role: LEADER
I20260806 02:20:02.635531 13168 raft_consensus.cc:2379] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cabbfb55e194ac8965872bad139793d in current term 1: Already voted for candidate 9b23881c63dd42faade1dba7beea510f in this term.
I20260806 02:20:02.635756 13473 consensus_queue.cc:237] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cabbfb55e194ac8965872bad139793d" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36609 } } peers { permanent_uuid: "9b23881c63dd42faade1dba7beea510f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 36707 } } peers { permanent_uuid: "0664dd5ec0a54ad686a3766580eff361" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 46055 } }
I20260806 02:20:02.636953 13456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.629470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:41827 (local address 127.26.189.131:36707)
0806 02:20:02.629602 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:02.629606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:02.631081 (+ 1475us) server_negotiation.cc:407] Connection header received
0806 02:20:02.631398 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:02.631402 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:02.631445 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:02.631492 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:02.632005 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.632702 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.635870 (+ 3168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.636422 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.636545 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.636590 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:02.636794 (+ 204us) server_negotiation.cc:299] Negotiation successful
0806 02:20:02.636861 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 02:20:02.636971 13488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.629425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:36707 (local address 127.26.189.129:41827)
0806 02:20:02.630980 (+ 1555us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:02.630996 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:02.631269 (+ 273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:02.631678 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:02.631681 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:02.631698 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:02.631854 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.631860 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.632835 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.632840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.635753 (+ 2913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:02.635765 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.636541 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.636545 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:02.636650 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.636671 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 02:20:02.636777 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 02:20:02.636839 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1486,"thread_start_us":95,"threads_started":1}
I20260806 02:20:02.637480 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "526c1fcaae6f42bb8287cc195b2be75b" candidate_uuid: "5cabbfb55e194ac8965872bad139793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b23881c63dd42faade1dba7beea510f" is_pre_election: true
I20260806 02:20:02.638113 12908 leader_election.cc:302] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cabbfb55e194ac8965872bad139793d; no voters: 0664dd5ec0a54ad686a3766580eff361, 9b23881c63dd42faade1dba7beea510f
I20260806 02:20:02.638476 13472 raft_consensus.cc:2726] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 02:20:02.639101 12790 catalog_manager.cc:5495] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b23881c63dd42faade1dba7beea510f (127.26.189.131). New cstate: current_term: 1 leader_uuid: "9b23881c63dd42faade1dba7beea510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cabbfb55e194ac8965872bad139793d" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b23881c63dd42faade1dba7beea510f" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 36707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0664dd5ec0a54ad686a3766580eff361" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 46055 } health_report { overall_health: UNKNOWN } } }
I20260806 02:20:02.660202 13456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.656563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49698 (local address 127.26.189.131:36707)
0806 02:20:02.656709 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:02.656714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:02.656730 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:20:02.656847 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:02.656850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:02.656904 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:02.657015 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:20:02.657265 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.657815 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.658699 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:02.658931 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:02.659042 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:02.659370 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:20:02.659792 (+ 422us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:20:02.659924 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:02.659983 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 02:20:02.660034 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 02:20:02.666178 13168 raft_consensus.cc:1261] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361 [term 1 FOLLOWER]: Refusing update from remote peer 9b23881c63dd42faade1dba7beea510f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:20:02.666227 12992 raft_consensus.cc:1261] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d [term 1 FOLLOWER]: Refusing update from remote peer 9b23881c63dd42faade1dba7beea510f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:20:02.667110 13492 consensus_queue.cc:1035] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0664dd5ec0a54ad686a3766580eff361" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 46055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:20:02.667297 13473 consensus_queue.cc:1035] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cabbfb55e194ac8965872bad139793d" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 36609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:20:02.674530 13498 mvcc.cc:205] Tried to move back new op lower bound from 7315385559713202176 to 7315385559598784512. Current Snapshot: MvccSnapshot[applied={T|T < 7315385559713202176}]
I20260806 02:20:02.684304 12790 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:20:02.684477 12790 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:20:02.686918 12790 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2cc0e7b7a6df41b5a1433ec15365c47c: Sending DeleteTablet for 3 replicas of tablet 526c1fcaae6f42bb8287cc195b2be75b
I20260806 02:20:02.687701 13330 tablet_service.cc:1514] Processing DeleteTablet for tablet 526c1fcaae6f42bb8287cc195b2be75b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:02 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:49692
I20260806 02:20:02.687775 13120 tablet_service.cc:1514] Processing DeleteTablet for tablet 526c1fcaae6f42bb8287cc195b2be75b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:02 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:40542
I20260806 02:20:02.688165 12949 tablet_service.cc:1514] Processing DeleteTablet for tablet 526c1fcaae6f42bb8287cc195b2be75b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:02 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:53424
I20260806 02:20:02.688373 13512 tablet_replica.cc:330] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f: stopping tablet replica
I20260806 02:20:02.688661 13513 tablet_replica.cc:330] T 526c1fcaae6f42bb8287cc195b2be75b P 5cabbfb55e194ac8965872bad139793d: stopping tablet replica
I20260806 02:20:02.688706 13512 raft_consensus.cc:2229] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:20:02.689092 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 12842
I20260806 02:20:02.696000 13512 raft_consensus.cc:2258] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:02.696436 13511 tablet_replica.cc:330] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361: stopping tablet replica
I20260806 02:20:02.696774 13511 raft_consensus.cc:2229] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:20:02.697113 13511 raft_consensus.cc:2258] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:02.698014 13512 ts_tablet_manager.cc:1905] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:20:02.698616 13511 ts_tablet_manager.cc:1905] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:20:02.701381 13511 ts_tablet_manager.cc:1918] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:20:02.701485 13511 log.cc:1196] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/526c1fcaae6f42bb8287cc195b2be75b
I20260806 02:20:02.701870 13511 ts_tablet_manager.cc:1939] T 526c1fcaae6f42bb8287cc195b2be75b P 0664dd5ec0a54ad686a3766580eff361: Deleting consensus metadata
I20260806 02:20:02.702164 13512 ts_tablet_manager.cc:1918] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:20:02.702349 13512 log.cc:1196] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/526c1fcaae6f42bb8287cc195b2be75b
I20260806 02:20:02.702777 13512 ts_tablet_manager.cc:1939] T 526c1fcaae6f42bb8287cc195b2be75b P 9b23881c63dd42faade1dba7beea510f: Deleting consensus metadata
I20260806 02:20:02.703267 12773 catalog_manager.cc:4841] TS 0664dd5ec0a54ad686a3766580eff361 (127.26.189.130:46055): tablet 526c1fcaae6f42bb8287cc195b2be75b (table test-table [id=1f8216d384d84ce196dc04495469136d]) successfully deleted
W20260806 02:20:02.704006 12775 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:36609 (error 108)
I20260806 02:20:02.704041 12774 catalog_manager.cc:4841] TS 9b23881c63dd42faade1dba7beea510f (127.26.189.131:36707): tablet 526c1fcaae6f42bb8287cc195b2be75b (table test-table [id=1f8216d384d84ce196dc04495469136d]) successfully deleted
I20260806 02:20:02.705080 13451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:02.704770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:36609 (local address 127.0.0.1:53438)
0806 02:20:02.704914 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:02.704992 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 02:20:02.705231 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 13063
W20260806 02:20:02.705261 12775 catalog_manager.cc:4584] TS 5cabbfb55e194ac8965872bad139793d (127.26.189.129:36609): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 526c1fcaae6f42bb8287cc195b2be75b: Network error: Client connection negotiation failed: client connection to 127.26.189.129:36609: connect: Connection refused (error 111)
I20260806 02:20:02.713889 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 13238
I20260806 02:20:02.728875 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 12745
I20260806 02:20:02.747148 27382 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 02:20:03.096367 27382 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 02:20:03.096477 27382 mini_ranger.cc:66] Stopping Ranger...
I20260806 02:20:03.442127 27382 mini_ranger.cc:68] Stopped Ranger
2026-08-06 02:20:03.442 UTC [11448] LOG: received smart shutdown request
2026-08-06 02:20:03.447 UTC [11448] LOG: background worker "logical replication launcher" (PID 11459) exited with exit code 1
2026-08-06 02:20:03.447 UTC [11452] LOG: shutting down
2026-08-06 02:20:03.624 UTC [11448] LOG: database system is shut down
2026-08-06T02:20:03Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52515 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:20:03 dist-test-slave-gkw7 krb5kdc[13529](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:20:03 dist-test-slave-gkw7 krb5kdc[13529](info): set up 2 sockets
Aug 06 02:20:03 dist-test-slave-gkw7 krb5kdc[13529](info): commencing operation
krb5kdc: starting...
W20260806 02:20:04.995803 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:20:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:20:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:20:05.129369 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:43747
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:43747,127.26.189.189:35497,127.26.189.188:46021
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:05.243965 13545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:05.244313 13545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:05.244400 13545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:05.248519 13545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:20:05.248611 13545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:05.248649 13545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:05.248700 13545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:20:05.248739 13545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:20:05.254055 13545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:43747,127.26.189.189:35497,127.26.189.188:46021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:43747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:05.255257 13545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:05.256335 13545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:05.265363 13553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:05.265319 13557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:05.265435 13554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:05.265715 13545 server_base.cc:1034] running on GCE node
I20260806 02:20:05.266376 13545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:05.267520 13545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:05.268692 13545 hybrid_clock.cc:648] HybridClock initialized: now 1785982805268675 us; error 27 us; skew 500 ppm
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:05.271757 13545 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:20:05.272842 13545 webserver.cc:460] Webserver started at http://127.26.189.190:37665/ using document root <none> and password file <none>
I20260806 02:20:05.273690 13545 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:05.273800 13545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:05.274098 13545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:20:05.277285 13545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293"
format_stamp: "Formatted at 2026-08-06 02:20:05 on dist-test-slave-gkw7"
server_key: "9a6c0e82a0ec2637338cd6aec40186b3"
server_key_iv: "da7763bd0a8b588eec1eea2e0a2818ae"
server_key_version: "encryptionkey@0"
I20260806 02:20:05.278055 13545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293"
format_stamp: "Formatted at 2026-08-06 02:20:05 on dist-test-slave-gkw7"
server_key: "9a6c0e82a0ec2637338cd6aec40186b3"
server_key_iv: "da7763bd0a8b588eec1eea2e0a2818ae"
server_key_version: "encryptionkey@0"
I20260806 02:20:05.282994 13545 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 02:20:05.285523 13566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:05.286921 13545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:05.287068 13545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293"
format_stamp: "Formatted at 2026-08-06 02:20:05 on dist-test-slave-gkw7"
server_key: "9a6c0e82a0ec2637338cd6aec40186b3"
server_key_iv: "da7763bd0a8b588eec1eea2e0a2818ae"
server_key_version: "encryptionkey@0"
I20260806 02:20:05.287186 13545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:05.306118 13545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:05.309273 13545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:05.309484 13545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:05.316434 13545 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:43747
I20260806 02:20:05.316704 13635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:43747 every 8 connection(s)
I20260806 02:20:05.317570 13545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:20:05.320408 13636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:05.324457 13636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:20:05.327015 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 13545
I20260806 02:20:05.327185 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:20:05.327545 27382 external_mini_cluster.cc:1428] Setting key b04624a88ac60c1d19a6fc84ee2bac99
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.189@KRBTEST.COM" created.
I20260806 02:20:05.341187 13640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.326837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58282 (local address 127.26.189.190:43747)
0806 02:20:05.327494 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.327515 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.327709 (+ 194us) server_negotiation.cc:407] Connection header received
0806 02:20:05.328738 (+ 1029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.328745 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.328984 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.329193 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.330233 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.331126 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.332766 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.333143 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.333282 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.336054 (+ 2772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.336062 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.336076 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.336107 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.338018 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.338575 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.338579 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.338581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.338688 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.338977 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.338980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.338981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.339364 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.339472 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.340015 (+ 543us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.340200 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"spinlock_wait_cycles":17280,"thread_start_us":169,"threads_started":1}
I20260806 02:20:05.341192 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.326837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:43747 (local address 127.0.0.1:58282)
0806 02:20:05.327515 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.327568 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:05.328418 (+ 850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:05.329201 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:05.329205 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:05.329662 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:05.330058 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.330080 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.331270 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.331276 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.332609 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.332625 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.333323 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.333330 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.333491 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.334160 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:05.334189 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:05.335898 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:05.338120 (+ 2222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.338129 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.338137 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.338465 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.338776 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.338778 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.338780 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.338897 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.339521 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:05.339536 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:05.339764 (+ 228us) client_negotiation.cc:769] Sending connection context
0806 02:20:05.339940 (+ 176us) client_negotiation.cc:240] Negotiation successful
0806 02:20:05.340318 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":47,"thread_start_us":155,"threads_started":1}
I20260806 02:20:05.343705 13636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:20:05.344553 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.344194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:35497 (local address 127.0.0.1:35342)
0806 02:20:05.344363 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.344460 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260806 02:20:05.344774 13567 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
I20260806 02:20:05.345731 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.345408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:35497 (local address 127.0.0.1:35348)
0806 02:20:05.345584 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.345646 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 02:20:05.345906 13636 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.189:35497: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.189.keytab.
Entry for principal kudu/127.26.189.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.189.keytab.
I20260806 02:20:05.356591 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.189:35497
--webserver_interface=127.26.189.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.189.keytab
--principal=kudu/127.26.189.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:43747,127.26.189.189:35497,127.26.189.188:46021
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:20:05.395184 13636 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } attempt: 1
I20260806 02:20:05.396327 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.395933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:35497 (local address 127.0.0.1:35354)
0806 02:20:05.396129 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.396213 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 02:20:05.397177 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.396912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:35497 (local address 127.0.0.1:35356)
0806 02:20:05.397037 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.397096 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 02:20:05.397374 13636 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.189:35497: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
I20260806 02:20:05.465593 13636 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } attempt: 2
I20260806 02:20:05.466578 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.466162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:35497 (local address 127.0.0.1:35362)
0806 02:20:05.466397 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.466477 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260806 02:20:05.467557 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.467300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:35497 (local address 127.0.0.1:35366)
0806 02:20:05.467430 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.467490 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 02:20:05.467757 13636 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.189:35497: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
W20260806 02:20:05.475225 13647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:05.475533 13647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:05.475636 13647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:05.479771 13647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:20:05.479861 13647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:05.479898 13647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:05.479949 13647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:20:05.479985 13647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:20:05.485714 13647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:43747,127.26.189.189:35497,127.26.189.188:46021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.189.keytab
--principal=kudu/127.26.189.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.189:35497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.189.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:05.486951 13647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:05.488041 13647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:05.497062 13668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:05.497076 13663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:05.497126 13660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:05.497380 13647 server_base.cc:1034] running on GCE node
I20260806 02:20:05.498126 13647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:05.499336 13647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:05.500538 13647 hybrid_clock.cc:648] HybridClock initialized: now 1785982805500516 us; error 34 us; skew 500 ppm
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:05.503490 13647 init.cc:377] Logged in from keytab as kudu/127.26.189.189@KRBTEST.COM (short username kudu)
I20260806 02:20:05.504436 13647 webserver.cc:460] Webserver started at http://127.26.189.189:43171/ using document root <none> and password file <none>
I20260806 02:20:05.505026 13647 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:05.505116 13647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:05.505366 13647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:20:05.507560 13647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/data/instance:
uuid: "4d0ce1ef49ea4003997845b973415b39"
format_stamp: "Formatted at 2026-08-06 02:20:05 on dist-test-slave-gkw7"
server_key: "dd346243c44e5ac48caa79c8642017ae"
server_key_iv: "9cd9705f39d736c2ea116b7402d66165"
server_key_version: "encryptionkey@0"
I20260806 02:20:05.508145 13647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/wal/instance:
uuid: "4d0ce1ef49ea4003997845b973415b39"
format_stamp: "Formatted at 2026-08-06 02:20:05 on dist-test-slave-gkw7"
server_key: "dd346243c44e5ac48caa79c8642017ae"
server_key_iv: "9cd9705f39d736c2ea116b7402d66165"
server_key_version: "encryptionkey@0"
I20260806 02:20:05.512079 13647 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:20:05.514689 13677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:05.515897 13647 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 02:20:05.516054 13647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/wal
uuid: "4d0ce1ef49ea4003997845b973415b39"
format_stamp: "Formatted at 2026-08-06 02:20:05 on dist-test-slave-gkw7"
server_key: "dd346243c44e5ac48caa79c8642017ae"
server_key_iv: "9cd9705f39d736c2ea116b7402d66165"
server_key_version: "encryptionkey@0"
I20260806 02:20:05.516173 13647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:05.558954 13636 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } attempt: 3
I20260806 02:20:05.559888 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.559524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:35497 (local address 127.0.0.1:35368)
0806 02:20:05.559711 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.559794 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 02:20:05.560657 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.560412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:35497 (local address 127.0.0.1:35376)
0806 02:20:05.560531 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.560587 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 02:20:05.560848 13636 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.189:35497: Network error: Client connection negotiation failed: client connection to 127.26.189.189:35497: connect: Connection refused (error 111)
I20260806 02:20:05.561764 13647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:05.564765 13647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:05.564968 13647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:05.572088 13647 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.189:35497
I20260806 02:20:05.572439 13749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.189:35497 every 8 connection(s)
I20260806 02:20:05.573190 13647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
I20260806 02:20:05.574127 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 13647
I20260806 02:20:05.574265 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-1/wal/instance
I20260806 02:20:05.574540 27382 external_mini_cluster.cc:1428] Setting key f71e4869ee6470eea68053e24e0a3d84
I20260806 02:20:05.576157 13750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:05.579984 13750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.189.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.188@KRBTEST.COM" created.
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.189@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:05.595193 13640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.582089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58290 (local address 127.26.189.190:43747)
0806 02:20:05.582230 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.582234 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.583365 (+ 1131us) server_negotiation.cc:407] Connection header received
0806 02:20:05.584390 (+ 1025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.584393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.584452 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.584559 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.585848 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.586485 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.587629 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.587875 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.587982 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.590888 (+ 2906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.590891 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.590893 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.590918 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.592712 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.593382 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.593385 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.593387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.593474 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.593960 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.593963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.593964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.594155 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.594232 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.594955 (+ 723us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.595066 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 02:20:05.596210 13753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.582653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:43747 (local address 127.0.0.1:58290)
0806 02:20:05.583210 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.583257 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:05.584153 (+ 896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:05.584734 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:05.584756 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:05.585083 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:05.585697 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.585712 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.586616 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.586619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.587497 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.587506 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.588025 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.588029 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.588197 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.588833 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:05.588849 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:05.590690 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:05.592845 (+ 2155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.592853 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.592870 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.593257 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.593626 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.593631 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.593634 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.593846 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.594265 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:05.594274 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:05.594658 (+ 384us) client_negotiation.cc:769] Sending connection context
0806 02:20:05.594906 (+ 248us) client_negotiation.cc:240] Negotiation successful
0806 02:20:05.595359 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":169,"threads_started":1}
I20260806 02:20:05.597681 13750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.189@KRBTEST.COM for kudu/127.26.189.189@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.188.keytab.
Entry for principal kudu/127.26.189.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.188.keytab.
I20260806 02:20:05.605062 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.188:46021
--webserver_interface=127.26.189.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.188.keytab
--principal=kudu/127.26.189.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:43747,127.26.189.189:35497,127.26.189.188:46021
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:20:05.606727 13753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.598167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:35497 (local address 127.0.0.1:35384)
0806 02:20:05.598302 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.598314 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:05.598381 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:05.598986 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:05.598989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:05.599123 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:05.599217 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.599222 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.600217 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.600220 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.600839 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.600849 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.601469 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.601472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.601583 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.602025 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:05.602039 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:05.603324 (+ 1285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:05.605144 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.605150 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.605152 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.605367 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.605704 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.605708 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.605710 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.605790 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.606220 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:05.606223 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:05.606318 (+ 95us) client_negotiation.cc:769] Sending connection context
0806 02:20:05.606426 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 02:20:05.606559 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 02:20:05.606833 13755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.598306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35384 (local address 127.26.189.189:35497)
0806 02:20:05.598630 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.598639 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.598657 (+ 18us) server_negotiation.cc:407] Connection header received
0806 02:20:05.598690 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.598694 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.598848 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.599006 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.599337 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.600106 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.600946 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.601360 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.601445 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.603470 (+ 2025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.603479 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.603489 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.603509 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.605034 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.605475 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.605485 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.605486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.605613 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.605882 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.605885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.605887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.606117 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.606257 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.606528 (+ 271us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.606653 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":159,"threads_started":1}
I20260806 02:20:05.608681 13750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:20:05.609400 13753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.609150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51392)
0806 02:20:05.609273 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.609341 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 02:20:05.609630 13678 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
I20260806 02:20:05.610515 13753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.610311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51408)
0806 02:20:05.610416 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.610467 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 02:20:05.610641 13750 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:46021: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
I20260806 02:20:05.659904 13750 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } attempt: 1
I20260806 02:20:05.660873 13753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.660550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51410)
0806 02:20:05.660723 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.660793 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 02:20:05.661644 13753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.661401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51418)
0806 02:20:05.661510 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.661589 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 02:20:05.661821 13750 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:46021: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
I20260806 02:20:05.704003 13636 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } attempt: 4
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.189@KRBTEST.COM
I20260806 02:20:05.714463 13755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.704796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35392 (local address 127.26.189.189:35497)
0806 02:20:05.704986 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.704994 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.705014 (+ 20us) server_negotiation.cc:407] Connection header received
0806 02:20:05.705201 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.705205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.705259 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.705359 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.705948 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.706507 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.707835 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.708762 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.708903 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.711136 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.711140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.711142 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.711168 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.712622 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.713096 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.713100 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.713102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.713196 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.713510 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.713514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.713522 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.713749 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.713870 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.714165 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.714293 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 02:20:05.714464 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.704652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:35497 (local address 127.0.0.1:35392)
0806 02:20:05.704914 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.704934 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:05.705059 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:05.705379 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:05.705383 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:05.705662 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:05.705805 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.705813 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.706640 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.706646 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.707691 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.707702 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.708906 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.708911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.709035 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.709650 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:05.709664 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:05.710973 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:05.712742 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.712748 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.712750 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.712980 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.713307 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.713310 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.713312 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.713407 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.713874 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:05.713879 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:05.713987 (+ 108us) client_negotiation.cc:769] Sending connection context
0806 02:20:05.714106 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 02:20:05.714265 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140}
I20260806 02:20:05.715658 13636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:20:05.716360 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.716121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51426)
0806 02:20:05.716243 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.716301 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 02:20:05.716984 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.716778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51440)
0806 02:20:05.716878 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.716926 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260806 02:20:05.717128 13636 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:46021: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
W20260806 02:20:05.725346 13756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:05.725708 13756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:05.725812 13756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:05.729909 13756 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:20:05.729984 13756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:05.730021 13756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:05.730082 13756 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260806 02:20:05.729981 13750 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } attempt: 2
W20260806 02:20:05.730118 13756 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:20:05.730819 13753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.730514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51456)
0806 02:20:05.730665 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.730738 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 02:20:05.731722 13753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.731451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51466)
0806 02:20:05.731568 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.731655 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260806 02:20:05.731900 13750 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:46021: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
I20260806 02:20:05.736148 13756 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:43747,127.26.189.189:35497,127.26.189.188:46021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.188.keytab
--principal=kudu/127.26.189.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.188:46021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.189.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:05.737197 13756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:05.738250 13756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:05.746860 13764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:05.746860 13763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:05.746896 13766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:05.747117 13756 server_base.cc:1034] running on GCE node
I20260806 02:20:05.747812 13756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:05.748874 13756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:05.750048 13756 hybrid_clock.cc:648] HybridClock initialized: now 1785982805750030 us; error 28 us; skew 500 ppm
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:05.752986 13756 init.cc:377] Logged in from keytab as kudu/127.26.189.188@KRBTEST.COM (short username kudu)
I20260806 02:20:05.754194 13756 webserver.cc:460] Webserver started at http://127.26.189.188:43257/ using document root <none> and password file <none>
I20260806 02:20:05.754810 13756 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:05.754876 13756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:05.755115 13756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:20:05.757228 13756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/data/instance:
uuid: "3e02f8bf2aeb4c0ab06dd039d982348d"
format_stamp: "Formatted at 2026-08-06 02:20:05 on dist-test-slave-gkw7"
server_key: "e600f98ae79ee178a6e6d8b48a6891f6"
server_key_iv: "fe4362a17c8e919da8a0ffccaced3bac"
server_key_version: "encryptionkey@0"
I20260806 02:20:05.757840 13756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/wal/instance:
uuid: "3e02f8bf2aeb4c0ab06dd039d982348d"
format_stamp: "Formatted at 2026-08-06 02:20:05 on dist-test-slave-gkw7"
server_key: "e600f98ae79ee178a6e6d8b48a6891f6"
server_key_iv: "fe4362a17c8e919da8a0ffccaced3bac"
server_key_version: "encryptionkey@0"
I20260806 02:20:05.761627 13756 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 02:20:05.764182 13775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:05.765462 13756 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:20:05.765638 13756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/wal
uuid: "3e02f8bf2aeb4c0ab06dd039d982348d"
format_stamp: "Formatted at 2026-08-06 02:20:05 on dist-test-slave-gkw7"
server_key: "e600f98ae79ee178a6e6d8b48a6891f6"
server_key_iv: "fe4362a17c8e919da8a0ffccaced3bac"
server_key_version: "encryptionkey@0"
I20260806 02:20:05.765753 13756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:05.776288 13636 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } attempt: 1
I20260806 02:20:05.777256 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.776876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51478)
0806 02:20:05.777072 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.777153 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 02:20:05.778038 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.777807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51492)
0806 02:20:05.777917 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.777974 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 02:20:05.778162 13636 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:46021: Network error: Client connection negotiation failed: client connection to 127.26.189.188:46021: connect: Connection refused (error 111)
I20260806 02:20:05.779567 13756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:05.782670 13756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:05.782829 13756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:05.789673 13756 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.188:46021
I20260806 02:20:05.789952 13848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.188:46021 every 8 connection(s)
I20260806 02:20:05.790742 13756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
I20260806 02:20:05.793711 13849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:05.794150 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 13756
I20260806 02:20:05.794283 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785982634882397-27382-0/minicluster-data/master-2/wal/instance
I20260806 02:20:05.794602 27382 external_mini_cluster.cc:1428] Setting key cc2ad3a0cdb4cb528cccf29ea042bbdc
I20260806 02:20:05.798839 13849 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.188@KRBTEST.COM
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.188@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:05.810580 13854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.796019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51504 (local address 127.26.189.188:46021)
0806 02:20:05.796463 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.796479 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.796517 (+ 38us) server_negotiation.cc:407] Connection header received
0806 02:20:05.797263 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.797281 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.797670 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.798021 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.798898 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.799957 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.800989 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.801657 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.801784 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.804549 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.804556 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.804568 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.804601 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.806739 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.807249 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.807259 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.807267 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.807402 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.807977 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.807982 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.807984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.808571 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.808832 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.809072 (+ 240us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.809414 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":138,"threads_started":1}
I20260806 02:20:05.810783 13640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.800661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58296 (local address 127.26.189.190:43747)
0806 02:20:05.800820 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.800825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.801179 (+ 354us) server_negotiation.cc:407] Connection header received
0806 02:20:05.801339 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.801342 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.801392 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.801478 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.802418 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.802926 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.804004 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.804392 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.804505 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.807161 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.807164 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.807166 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.807210 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.808860 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.809456 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.809460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.809461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.809576 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.809844 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.809848 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.809850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.810068 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.810173 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.810499 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.810638 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 02:20:05.810844 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.800600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:43747 (local address 127.0.0.1:58296)
0806 02:20:05.801057 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.801099 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:05.801239 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:05.801559 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:05.801565 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:05.802095 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:05.802270 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.802277 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.803064 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.803067 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.803853 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.803863 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.804549 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.804553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.804679 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.805282 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:05.805298 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:05.807008 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:05.809009 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.809020 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.809026 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.809373 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.809667 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.809669 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.809670 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.809754 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.810175 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:05.810180 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:05.810301 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 02:20:05.810416 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 02:20:05.810553 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":162,"threads_started":1}
I20260806 02:20:05.811914 13849 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.188@KRBTEST.COM for kudu/127.26.189.189@KRBTEST.COM
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:05.820693 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.812475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:35497 (local address 127.0.0.1:35408)
0806 02:20:05.812596 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.812608 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:05.812712 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:05.812966 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:05.812970 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:05.813150 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:05.813264 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.813273 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.814231 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.814237 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.814772 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.814806 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.815246 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.815249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.815338 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.815839 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:05.815853 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:05.817118 (+ 1265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:05.819107 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.819113 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.819117 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.819421 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.819715 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.819718 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.819720 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.819804 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.820178 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:05.820181 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:05.820284 (+ 103us) client_negotiation.cc:769] Sending connection context
0806 02:20:05.820390 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 02:20:05.820523 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 02:20:05.820705 13755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.812582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35408 (local address 127.26.189.189:35497)
0806 02:20:05.812717 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.812722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.812737 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:20:05.812791 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.812794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.812857 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.812923 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.813450 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.814117 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.814923 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.815138 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.815219 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.817287 (+ 2068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.817290 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.817292 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.817316 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.818972 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.819526 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.819529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.819531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.819616 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.819894 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.819898 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.819900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.820083 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.820188 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.820446 (+ 258us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.820560 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 02:20:05.821417 13849 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:20:05.822317 13640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.813288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58312 (local address 127.26.189.190:43747)
0806 02:20:05.813412 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.813418 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.813432 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:20:05.813572 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.813575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.813617 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.813695 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.814277 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.814740 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.815690 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.815926 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.816033 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.818585 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.818589 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.818591 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.818618 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.820160 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.820626 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.820630 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.820632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.820716 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.821319 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.821321 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.821322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.821589 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.821839 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.822006 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.822129 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 02:20:05.823057 13750 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } attempt: 3
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.188@KRBTEST.COM for kudu/127.26.189.188@KRBTEST.COM
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.189@KRBTEST.COM for kudu/127.26.189.188@KRBTEST.COM
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.189@KRBTEST.COM
I20260806 02:20:05.830844 13854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.822134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51520 (local address 127.26.189.188:46021)
0806 02:20:05.822274 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.822278 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.822291 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:20:05.822326 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.822329 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.822366 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.822702 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.823100 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.823859 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.824744 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.824976 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.825080 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.827251 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.827255 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.827257 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.827280 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.828924 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.829395 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.829400 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.829402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.829484 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.829834 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.829838 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.829840 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.830062 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.830137 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.830503 (+ 366us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.830631 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 02:20:05.831493 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.821962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51520)
0806 02:20:05.822062 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.822076 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:05.822150 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:05.822787 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:05.822789 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:05.822915 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:05.822994 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.823000 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.823964 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.823969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.824624 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.824632 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.825078 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.825081 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.825165 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.825672 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:05.825687 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:05.827116 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:05.829093 (+ 1977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.829097 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.829098 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.829299 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.829603 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.829609 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.829614 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.829728 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.830205 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:05.830209 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:05.830317 (+ 108us) client_negotiation.cc:769] Sending connection context
0806 02:20:05.831066 (+ 749us) client_negotiation.cc:240] Negotiation successful
0806 02:20:05.831316 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":3}
I20260806 02:20:05.833384 13753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.823481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51526)
0806 02:20:05.823581 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.823596 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:05.823689 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:05.824354 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:05.824361 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:05.824539 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:05.824637 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.824645 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.826109 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.826113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.826635 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.826643 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.827179 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.827182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.827272 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.827723 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:05.827749 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:05.829356 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:05.831539 (+ 2183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.831544 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.831548 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.831916 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.832214 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.832219 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.832223 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.832348 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.832813 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:05.832816 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:05.832939 (+ 123us) client_negotiation.cc:769] Sending connection context
0806 02:20:05.833060 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 02:20:05.833218 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"spinlock_wait_cycles":12160}
I20260806 02:20:05.833403 13856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.823727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51526 (local address 127.26.189.188:46021)
0806 02:20:05.824083 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.824092 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.824104 (+ 12us) server_negotiation.cc:407] Connection header received
0806 02:20:05.824135 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.824138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.824175 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.824269 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.824791 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.825982 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.826757 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.827064 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.827174 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.829481 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.829484 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.829487 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.829508 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.831409 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.832016 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.832021 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.832026 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.832113 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.832463 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.832467 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.832470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.832684 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.832817 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.833128 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.833238 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":113,"threads_started":1}
I20260806 02:20:05.834590 13755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.823730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35414 (local address 127.26.189.189:35497)
0806 02:20:05.823838 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.823841 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.824072 (+ 231us) server_negotiation.cc:407] Connection header received
0806 02:20:05.824185 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.824188 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.824228 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.824374 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.825299 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.826035 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.827191 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.827534 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.827606 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.830532 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.830536 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.830539 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.830561 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.832265 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.832755 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.832761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.832766 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.832856 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.833179 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.833184 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.833186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.833388 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.833646 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.833985 (+ 339us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.834398 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 02:20:05.835391 13849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d: Bootstrap starting.
I20260806 02:20:05.838503 13849 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:05.838975 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:20:05.839340 13849 log.cc:824] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:05.842763 13750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39: Bootstrap starting.
I20260806 02:20:05.845599 13750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:05.845566 13636 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } attempt: 2
I20260806 02:20:05.846940 13750 log.cc:824] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:05.849447 13849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d: No bootstrap required, opened a new log
Aug 06 02:20:05 dist-test-slave-gkw7 krb5kdc[13529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982805, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.188@KRBTEST.COM
I20260806 02:20:05.852938 13640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.841410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58316 (local address 127.26.189.190:43747)
0806 02:20:05.841524 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.841576 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.841593 (+ 17us) server_negotiation.cc:407] Connection header received
0806 02:20:05.841760 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.841763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.841828 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.841898 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.842862 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.843654 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.845198 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.845803 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.845879 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.847835 (+ 1956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.847840 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.847845 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.847879 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.850002 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.851378 (+ 1376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.851381 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.851383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.851471 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.851825 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.851828 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.851830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.852078 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.852215 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.852607 (+ 392us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.852747 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 02:20:05.854346 13849 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } }
I20260806 02:20:05.854622 13849 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:05.854673 13849 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e02f8bf2aeb4c0ab06dd039d982348d, State: Initialized, Role: FOLLOWER
I20260806 02:20:05.854707 13755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.841151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35420 (local address 127.26.189.189:35497)
0806 02:20:05.841272 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.841277 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.841995 (+ 718us) server_negotiation.cc:407] Connection header received
0806 02:20:05.842169 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.842174 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.842239 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.842338 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.843168 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.843861 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.845043 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.845356 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.845447 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.851010 (+ 5563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.851014 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.851017 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.851043 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.852745 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.853238 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.853254 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.853256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.853344 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.853716 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.853720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.853721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.853935 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.854044 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.854420 (+ 376us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.854541 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 02:20:05.856590 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.845984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:46021 (local address 127.0.0.1:51536)
0806 02:20:05.846218 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:05.846234 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:05.846328 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:05.846895 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:05.846898 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:05.847104 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:05.847220 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.847230 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.848201 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.848206 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.848964 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:05.848975 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.849633 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.849638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:05.849736 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.850492 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:05.850508 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:05.852607 (+ 2099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:05.854908 (+ 2301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.854915 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.854918 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.855169 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.855495 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:05.855498 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:05.855499 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:05.855597 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:05.856071 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:05.856077 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:05.856171 (+ 94us) client_negotiation.cc:769] Sending connection context
0806 02:20:05.856285 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 02:20:05.856430 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167}
I20260806 02:20:05.856626 13854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.846472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51536 (local address 127.26.189.188:46021)
0806 02:20:05.846599 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.846605 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.846622 (+ 17us) server_negotiation.cc:407] Connection header received
0806 02:20:05.846657 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.846660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.846705 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.846778 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.847380 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.848064 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.849102 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.849433 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.849564 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.852752 (+ 3188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.852756 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.852758 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.852782 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.854809 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.855290 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.855295 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.855297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.855378 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.855701 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.855705 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.855707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.855933 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.856023 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.856371 (+ 348us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.856486 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 02:20:05.856942 13750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39: No bootstrap required, opened a new log
I20260806 02:20:05.857352 13856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:05.841823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51532 (local address 127.26.189.188:46021)
0806 02:20:05.841952 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:05.841957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:05.843039 (+ 1082us) server_negotiation.cc:407] Connection header received
0806 02:20:05.843202 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:05.843205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:05.843249 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:05.843298 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:05.844154 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.844940 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.846094 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:05.846449 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:05.846547 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:05.848305 (+ 1758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:05.848309 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:05.848311 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:05.848341 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:05.850869 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.855619 (+ 4750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.855625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.855630 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.855714 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:05.856025 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:05.856028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:05.856031 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:05.856212 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:05.856353 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:05.857109 (+ 756us) server_negotiation.cc:299] Negotiation successful
0806 02:20:05.857245 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 02:20:05.859730 13636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293: Bootstrap starting.
I20260806 02:20:05.861020 13750 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } }
I20260806 02:20:05.861260 13750 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:05.861321 13750 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d0ce1ef49ea4003997845b973415b39, State: Initialized, Role: FOLLOWER
I20260806 02:20:05.861927 13849 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } }
I20260806 02:20:05.861941 13750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } }
I20260806 02:20:05.862579 13871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } } }
I20260806 02:20:05.862651 13636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:05.862809 13871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:20:05.863322 13849 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:20:05.863337 13750 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:20:05.863538 13636 log.cc:824] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:05.866259 13636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293: No bootstrap required, opened a new log
I20260806 02:20:05.870409 13636 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } }
I20260806 02:20:05.870800 13636 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:05.867591 13756 master_runner.cc:186] Error getting master registration for 127.26.189.190:43747: OK, instance_id { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" instance_seqno: 1785982805314524 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 02:20:05.870909 13636 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9c0d166bcb44fbb8dc80cc8eeb42293, State: Initialized, Role: FOLLOWER
I20260806 02:20:05.871022 13756 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 02:20:05.871492 13897 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:20:05.871574 13897 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:20:05.871500 13636 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } }
I20260806 02:20:05.867349 13647 master_runner.cc:186] Error getting master registration for 127.26.189.190:43747: OK, instance_id { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" instance_seqno: 1785982805314524 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 02:20:05.871918 13647 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 02:20:05.872079 13905 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } } }
I20260806 02:20:05.872259 13905 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:20:05.872936 13636 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:20:05.874253 13870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } } }
I20260806 02:20:05.874383 13870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 02:20:05.877475 13902 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:20:05.877591 13902 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260806 02:20:05.877820 13917 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:20:05.877928 13917 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:20:05.881592 13545 master_runner.cc:263] No leader master found from master d9c0d166bcb44fbb8dc80cc8eeb42293
I20260806 02:20:05.881666 13545 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 02:20:06.034220 13784 tablet.cc:2369] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 02:20:06.061328 13573 tablet.cc:2369] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 02:20:06.066629 13686 tablet.cc:2369] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:20:06.183799 13870 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:06.184013 13870 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } }
I20260806 02:20:06.185009 13870 leader_election.cc:288] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9c0d166bcb44fbb8dc80cc8eeb42293 (127.26.189.190:43747), 3e02f8bf2aeb4c0ab06dd039d982348d (127.26.189.188:46021)
I20260806 02:20:06.185628 13602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d0ce1ef49ea4003997845b973415b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" is_pre_election: true
I20260806 02:20:06.185648 13813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d0ce1ef49ea4003997845b973415b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" is_pre_election: true
I20260806 02:20:06.185942 13813 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d0ce1ef49ea4003997845b973415b39 in term 0.
I20260806 02:20:06.185958 13602 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d0ce1ef49ea4003997845b973415b39 in term 0.
I20260806 02:20:06.186393 13678 leader_election.cc:302] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e02f8bf2aeb4c0ab06dd039d982348d, 4d0ce1ef49ea4003997845b973415b39; no voters:
I20260806 02:20:06.186678 13870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:20:06.186774 13870 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:20:06.186818 13870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:06.187928 13870 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } }
I20260806 02:20:06.188252 13870 leader_election.cc:288] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [CANDIDATE]: Term 1 election: Requested vote from peers d9c0d166bcb44fbb8dc80cc8eeb42293 (127.26.189.190:43747), 3e02f8bf2aeb4c0ab06dd039d982348d (127.26.189.188:46021)
I20260806 02:20:06.188628 13813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d0ce1ef49ea4003997845b973415b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d"
I20260806 02:20:06.188648 13602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d0ce1ef49ea4003997845b973415b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293"
I20260806 02:20:06.188774 13602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:06.188774 13813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:06.190152 13813 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d0ce1ef49ea4003997845b973415b39 in term 1.
I20260806 02:20:06.190145 13602 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d0ce1ef49ea4003997845b973415b39 in term 1.
I20260806 02:20:06.190490 13679 leader_election.cc:302] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d0ce1ef49ea4003997845b973415b39, d9c0d166bcb44fbb8dc80cc8eeb42293; no voters:
I20260806 02:20:06.191022 13870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:20:06.191278 13870 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [term 1 LEADER]: Becoming Leader. State: Replica: 4d0ce1ef49ea4003997845b973415b39, State: Running, Role: LEADER
I20260806 02:20:06.191638 13870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } }
I20260806 02:20:06.193878 13920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d0ce1ef49ea4003997845b973415b39. Latest consensus state: current_term: 1 leader_uuid: "4d0ce1ef49ea4003997845b973415b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } } }
I20260806 02:20:06.194029 13920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:06.194482 13922 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:20:06.195348 13922 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:20:06.200101 13602 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [term 1 FOLLOWER]: Refusing update from remote peer 4d0ce1ef49ea4003997845b973415b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:20:06.200102 13813 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [term 1 FOLLOWER]: Refusing update from remote peer 4d0ce1ef49ea4003997845b973415b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:20:06.200769 13920 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:20:06.200911 13870 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:20:06.204690 13905 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d0ce1ef49ea4003997845b973415b39. Latest consensus state: current_term: 1 leader_uuid: "4d0ce1ef49ea4003997845b973415b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } } }
I20260806 02:20:06.204815 13905 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:20:06.205031 13871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d0ce1ef49ea4003997845b973415b39. Latest consensus state: current_term: 1 leader_uuid: "4d0ce1ef49ea4003997845b973415b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } } }
I20260806 02:20:06.205178 13871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:20:06.207263 13870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4d0ce1ef49ea4003997845b973415b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } } }
I20260806 02:20:06.207436 13870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:06.207993 13870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4d0ce1ef49ea4003997845b973415b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } } }
I20260806 02:20:06.208133 13870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:06.208287 13905 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d0ce1ef49ea4003997845b973415b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } } }
I20260806 02:20:06.208415 13905 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:20:06.208626 13922 catalog_manager.cc:1347] Generated new cluster ID: e438e4578b774d2d89438f40b69df8c6
I20260806 02:20:06.208681 13922 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:20:06.209306 13871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d0ce1ef49ea4003997845b973415b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c0d166bcb44fbb8dc80cc8eeb42293" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 43747 } } peers { permanent_uuid: "4d0ce1ef49ea4003997845b973415b39" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 35497 } } peers { permanent_uuid: "3e02f8bf2aeb4c0ab06dd039d982348d" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 46021 } } }
I20260806 02:20:06.209448 13871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:20:06.213651 13925 mvcc.cc:205] Tried to move back new op lower bound from 7315385574188756992 to 7315385574163857408. Current Snapshot: MvccSnapshot[applied={T|T < 7315385574188756992 or (T in {7315385574188756992})}]
I20260806 02:20:06.226485 13922 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:20:06.227599 13922 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:20:06.236012 13922 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d0ce1ef49ea4003997845b973415b39: Generated new TSK 0
I20260806 02:20:06.237229 13922 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:20:06.878957 13902 catalog_manager.cc:1259] Loaded cluster ID: e438e4578b774d2d89438f40b69df8c6
I20260806 02:20:06.879043 13902 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d: loading cluster ID for follower catalog manager: success
I20260806 02:20:06.879151 13917 catalog_manager.cc:1259] Loaded cluster ID: e438e4578b774d2d89438f40b69df8c6
I20260806 02:20:06.879237 13917 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293: loading cluster ID for follower catalog manager: success
I20260806 02:20:06.880738 13917 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293: acquiring CA information for follower catalog manager: success
I20260806 02:20:06.880735 13902 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d: acquiring CA information for follower catalog manager: success
I20260806 02:20:06.881947 13917 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d9c0d166bcb44fbb8dc80cc8eeb42293: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 02:20:06.881947 13902 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3e02f8bf2aeb4c0ab06dd039d982348d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 02:20:07.301898 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 13545
I20260806 02:20:07.316663 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 13647
I20260806 02:20:07.327303 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 13756
2026-08-06T02:20:07Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3556 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:20:07 dist-test-slave-gkw7 krb5kdc[13948](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:20:07 dist-test-slave-gkw7 krb5kdc[13948](info): set up 2 sockets
Aug 06 02:20:07 dist-test-slave-gkw7 krb5kdc[13948](info): commencing operation
krb5kdc: starting...
W20260806 02:20:08.564082 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:20:08 dist-test-slave-gkw7 krb5kdc[13948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:20:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:20:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:20:08.707096 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:45627
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:45627
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:08.822269 13964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:08.822585 13964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:08.822682 13964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:08.826683 13964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:20:08.826776 13964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:08.826814 13964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:08.826869 13964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:20:08.826903 13964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:20:08.832229 13964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:45627
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:45627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:08.833346 13964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:08.834415 13964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:08.843312 13969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:08.843516 13964 server_base.cc:1034] running on GCE node
W20260806 02:20:08.843340 13972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:08.843317 13970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:08.844364 13964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:08.845824 13964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:08.847002 13964 hybrid_clock.cc:648] HybridClock initialized: now 1785982808846961 us; error 52 us; skew 500 ppm
Aug 06 02:20:08 dist-test-slave-gkw7 krb5kdc[13948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982808, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:08.855904 13964 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:20:08.856953 13964 webserver.cc:460] Webserver started at http://127.26.189.190:42287/ using document root <none> and password file <none>
I20260806 02:20:08.857621 13964 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:08.857694 13964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:08.857956 13964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:20:08.860147 13964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "5c92c2040d234fff8ff7aac0e8cb4aca"
format_stamp: "Formatted at 2026-08-06 02:20:08 on dist-test-slave-gkw7"
server_key: "71d7ef7ede5f32f9770366455b60390e"
server_key_iv: "1d992a6b581a8c5449f14c2acbdc1e09"
server_key_version: "encryptionkey@0"
I20260806 02:20:08.860752 13964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "5c92c2040d234fff8ff7aac0e8cb4aca"
format_stamp: "Formatted at 2026-08-06 02:20:08 on dist-test-slave-gkw7"
server_key: "71d7ef7ede5f32f9770366455b60390e"
server_key_iv: "1d992a6b581a8c5449f14c2acbdc1e09"
server_key_version: "encryptionkey@0"
I20260806 02:20:08.864871 13964 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:20:08.867650 13984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:08.869014 13964 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:20:08.869194 13964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "5c92c2040d234fff8ff7aac0e8cb4aca"
format_stamp: "Formatted at 2026-08-06 02:20:08 on dist-test-slave-gkw7"
server_key: "71d7ef7ede5f32f9770366455b60390e"
server_key_iv: "1d992a6b581a8c5449f14c2acbdc1e09"
server_key_version: "encryptionkey@0"
I20260806 02:20:08.869323 13964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:08.912865 13964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:08.916317 13964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:08.916563 13964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:08.924690 13964 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:45627
I20260806 02:20:08.924710 14049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:45627 every 8 connection(s)
I20260806 02:20:08.925858 13964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:20:08.929023 14051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:08.935248 14051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca: Bootstrap starting.
I20260806 02:20:08.935875 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 13964
I20260806 02:20:08.936019 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:20:08.936316 27382 external_mini_cluster.cc:1428] Setting key 5bfdc554f47518d35d294c6f714a1324
I20260806 02:20:08.938247 14051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:08.939077 14051 log.cc:824] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:08.941339 14051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca: No bootstrap required, opened a new log
Aug 06 02:20:08 dist-test-slave-gkw7 krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:08.945375 14051 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c92c2040d234fff8ff7aac0e8cb4aca" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45627 } }
I20260806 02:20:08.945710 14051 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:08.945814 14051 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c92c2040d234fff8ff7aac0e8cb4aca, State: Initialized, Role: FOLLOWER
I20260806 02:20:08.946403 14051 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c92c2040d234fff8ff7aac0e8cb4aca" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45627 } }
I20260806 02:20:08.946623 14051 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:20:08.946710 14051 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:20:08.946832 14051 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:08.947930 14051 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c92c2040d234fff8ff7aac0e8cb4aca" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45627 } }
I20260806 02:20:08.948335 14051 leader_election.cc:302] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c92c2040d234fff8ff7aac0e8cb4aca; no voters:
I20260806 02:20:08.948745 14051 leader_election.cc:288] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:20:08.948875 14056 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:20:08.949121 14056 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [term 1 LEADER]: Becoming Leader. State: Replica: 5c92c2040d234fff8ff7aac0e8cb4aca, State: Running, Role: LEADER
I20260806 02:20:08.949461 14056 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c92c2040d234fff8ff7aac0e8cb4aca" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45627 } }
I20260806 02:20:08.950418 14051 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:20:08.951607 14054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:08.937703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45706 (local address 127.26.189.190:45627)
0806 02:20:08.938128 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:08.938145 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:08.938181 (+ 36us) server_negotiation.cc:407] Connection header received
0806 02:20:08.938888 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:08.938908 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:08.939273 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:08.939641 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:08.940502 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:08.941575 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:08.942467 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:08.942961 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:08.943135 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:08.945722 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:08.945731 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:08.945751 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:08.945786 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:08.947834 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:08.948359 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:08.948365 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:08.948372 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:08.948528 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:08.948886 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:08.948892 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:08.948896 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:08.949485 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:08.949738 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:08.950139 (+ 401us) server_negotiation.cc:299] Negotiation successful
0806 02:20:08.950493 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":136,"threads_started":1}
I20260806 02:20:08.951581 14057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c92c2040d234fff8ff7aac0e8cb4aca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c92c2040d234fff8ff7aac0e8cb4aca" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45627 } } }
I20260806 02:20:08.951701 14057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:08.952160 14072 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:20:08.952741 14058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c92c2040d234fff8ff7aac0e8cb4aca. Latest consensus state: current_term: 1 leader_uuid: "5c92c2040d234fff8ff7aac0e8cb4aca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c92c2040d234fff8ff7aac0e8cb4aca" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45627 } } }
I20260806 02:20:08.952939 14058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:08.955138 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:20:08.955487 14072 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:20:08.961869 14072 catalog_manager.cc:1347] Generated new cluster ID: 1db58baa052649cf9020799c6a57b0c4
I20260806 02:20:08.961946 14072 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:20:08.977792 14072 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:20:08.978744 14072 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:20:08.990855 14072 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c92c2040d234fff8ff7aac0e8cb4aca: Generated new TSK 0
I20260806 02:20:08.991565 14072 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:20:09.011620 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 13964
2026-08-06T02:20:09Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1686 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:20:09 dist-test-slave-gkw7 krb5kdc[14089](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:20:09 dist-test-slave-gkw7 krb5kdc[14089](info): set up 2 sockets
Aug 06 02:20:09 dist-test-slave-gkw7 krb5kdc[14089](info): commencing operation
krb5kdc: starting...
W20260806 02:20:10.223201 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:20:10 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:20:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:20:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:20:10.361135 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39557
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:39557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:10.477264 14112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:10.477608 14112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:10.477748 14112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:10.481813 14112 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:20:10.481879 14112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:10.481899 14112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:10.481915 14112 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:20:10.481930 14112 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:20:10.487511 14112 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:39557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:10.488677 14112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:10.489841 14112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:10.499033 14119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:10.499043 14122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:10.499043 14118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:10.499393 14112 server_base.cc:1034] running on GCE node
I20260806 02:20:10.500015 14112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:10.501133 14112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:10.502329 14112 hybrid_clock.cc:648] HybridClock initialized: now 1785982810502311 us; error 32 us; skew 500 ppm
Aug 06 02:20:10 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982810, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:10.505079 14112 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:20:10.506098 14112 webserver.cc:460] Webserver started at http://127.26.189.190:43441/ using document root <none> and password file <none>
I20260806 02:20:10.506687 14112 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:10.506800 14112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:10.507052 14112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:20:10.509163 14112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "2e17fa9520b340bb95215aa07afb72a6"
format_stamp: "Formatted at 2026-08-06 02:20:10 on dist-test-slave-gkw7"
server_key: "54ec62cd5b172f54a2debabfb7e431b8"
server_key_iv: "dd86cf09f6c92f88fb034dc2d9b447e3"
server_key_version: "encryptionkey@0"
I20260806 02:20:10.509821 14112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "2e17fa9520b340bb95215aa07afb72a6"
format_stamp: "Formatted at 2026-08-06 02:20:10 on dist-test-slave-gkw7"
server_key: "54ec62cd5b172f54a2debabfb7e431b8"
server_key_iv: "dd86cf09f6c92f88fb034dc2d9b447e3"
server_key_version: "encryptionkey@0"
I20260806 02:20:10.513705 14112 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 02:20:10.516395 14131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:10.517845 14112 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:10.517987 14112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "2e17fa9520b340bb95215aa07afb72a6"
format_stamp: "Formatted at 2026-08-06 02:20:10 on dist-test-slave-gkw7"
server_key: "54ec62cd5b172f54a2debabfb7e431b8"
server_key_iv: "dd86cf09f6c92f88fb034dc2d9b447e3"
server_key_version: "encryptionkey@0"
I20260806 02:20:10.518102 14112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:10.554694 14112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:10.558044 14112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:10.558277 14112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:10.566210 14112 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:39557
I20260806 02:20:10.566545 14206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:39557 every 8 connection(s)
I20260806 02:20:10.567303 14112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:20:10.569578 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 14112
I20260806 02:20:10.569742 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:20:10.570109 27382 external_mini_cluster.cc:1428] Setting key 7ec648e7713d057e88f490959dce1b92
I20260806 02:20:10.570924 14208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:10.577693 14208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Bootstrap starting.
Aug 06 02:20:10 dist-test-slave-gkw7 krb5kdc[14089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:10.580395 14208 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:10.581352 14208 log.cc:824] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:10.583926 14208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: No bootstrap required, opened a new log
I20260806 02:20:10.585443 14211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:10.571776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60508 (local address 127.26.189.190:39557)
0806 02:20:10.572284 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:10.572300 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:10.572340 (+ 40us) server_negotiation.cc:407] Connection header received
0806 02:20:10.572990 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:10.573006 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:10.573344 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:10.573729 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:10.574563 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:10.575595 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:10.576505 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:10.576994 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:10.577172 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:10.579928 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:10.579934 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:10.579948 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:10.579976 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:10.581963 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:10.582590 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:10.582596 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:10.582602 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:10.582745 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:10.583073 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:10.583079 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:10.583083 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:10.583604 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:10.583808 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:10.584142 (+ 334us) server_negotiation.cc:299] Negotiation successful
0806 02:20:10.584490 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":159,"threads_started":1}
I20260806 02:20:10.588061 14208 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } }
I20260806 02:20:10.588294 14208 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:10.588331 14208 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e17fa9520b340bb95215aa07afb72a6, State: Initialized, Role: FOLLOWER
I20260806 02:20:10.588747 14208 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } }
I20260806 02:20:10.588872 14208 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:20:10.588913 14208 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:20:10.588985 14208 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:10.590025 14208 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } }
I20260806 02:20:10.590332 14208 leader_election.cc:302] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e17fa9520b340bb95215aa07afb72a6; no voters:
I20260806 02:20:10.590641 14208 leader_election.cc:288] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:20:10.590765 14213 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:20:10.591010 14213 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 1 LEADER]: Becoming Leader. State: Replica: 2e17fa9520b340bb95215aa07afb72a6, State: Running, Role: LEADER
I20260806 02:20:10.591331 14213 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } }
I20260806 02:20:10.592053 14208 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:20:10.593186 14215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e17fa9520b340bb95215aa07afb72a6. Latest consensus state: current_term: 1 leader_uuid: "2e17fa9520b340bb95215aa07afb72a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } } }
I20260806 02:20:10.593334 14215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:10.593669 14214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e17fa9520b340bb95215aa07afb72a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } } }
I20260806 02:20:10.593770 14214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:10.593884 14225 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:20:10.597126 14225 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:20:10.603241 14225 catalog_manager.cc:1347] Generated new cluster ID: 7c1f2b1eebc747f799ac3f3b357ca94b
I20260806 02:20:10.603324 14225 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:20:10.616693 14225 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:20:10.618063 14225 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:20:10.623221 14225 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Generated new TSK 0
I20260806 02:20:10.624013 14225 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:20:10.657392 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39557
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:10.774881 14240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:10.775154 14240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:10.775239 14240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:10.779232 14240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:10.779292 14240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:10.779390 14240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:20:10.784826 14240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:10.785949 14240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:10.786976 14240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:10.796892 14245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:10.796900 14247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:10.796883 14249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:10.797096 14240 server_base.cc:1034] running on GCE node
I20260806 02:20:10.797720 14240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:10.798377 14240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:10.799537 14240 hybrid_clock.cc:648] HybridClock initialized: now 1785982810799503 us; error 47 us; skew 500 ppm
Aug 06 02:20:10 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982810, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:10.802416 14240 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:20:10.803331 14240 webserver.cc:460] Webserver started at http://127.26.189.129:46055/ using document root <none> and password file <none>
I20260806 02:20:10.803911 14240 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:10.803974 14240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:10.804241 14240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:20:10.806394 14240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "c0d526359ccd43f182b33b4c92fb94a4"
format_stamp: "Formatted at 2026-08-06 02:20:10 on dist-test-slave-gkw7"
server_key: "bfa93e3ddaa260f21199e51f343627af"
server_key_iv: "96cabbbae4e0494c5ac560543971f41a"
server_key_version: "encryptionkey@0"
I20260806 02:20:10.806967 14240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "c0d526359ccd43f182b33b4c92fb94a4"
format_stamp: "Formatted at 2026-08-06 02:20:10 on dist-test-slave-gkw7"
server_key: "bfa93e3ddaa260f21199e51f343627af"
server_key_iv: "96cabbbae4e0494c5ac560543971f41a"
server_key_version: "encryptionkey@0"
I20260806 02:20:10.810798 14240 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:20:10.813375 14256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:10.814635 14240 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:20:10.814783 14240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "c0d526359ccd43f182b33b4c92fb94a4"
format_stamp: "Formatted at 2026-08-06 02:20:10 on dist-test-slave-gkw7"
server_key: "bfa93e3ddaa260f21199e51f343627af"
server_key_iv: "96cabbbae4e0494c5ac560543971f41a"
server_key_version: "encryptionkey@0"
I20260806 02:20:10.814903 14240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:10.828934 14240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:10.832077 14240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:10.832298 14240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:10.832924 14240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:10.834182 14240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:10.834270 14240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:10.834342 14240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:10.834379 14240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:10.843539 14240 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:44879
I20260806 02:20:10.843560 14407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:44879 every 8 connection(s)
I20260806 02:20:10.844492 14240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:20:10.845619 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 14240
I20260806 02:20:10.845775 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:20:10.846099 27382 external_mini_cluster.cc:1428] Setting key 95831417f0884ad83bb3cf351e1c0d85
Aug 06 02:20:10 dist-test-slave-gkw7 krb5kdc[14089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982810, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:20:10.861234 14211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:10.846584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:51575 (local address 127.26.189.190:39557)
0806 02:20:10.846737 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:10.846741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:10.847865 (+ 1124us) server_negotiation.cc:407] Connection header received
0806 02:20:10.850033 (+ 2168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:10.850038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:10.850105 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:10.850204 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:10.851402 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:10.851984 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:10.853596 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:10.854105 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:10.854238 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:10.857518 (+ 3280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:10.857525 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:10.857552 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:10.857587 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:10.859078 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:10.859577 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:10.859579 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:10.859581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:10.859656 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:10.859946 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:10.859948 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:10.859949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:10.860213 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:10.860297 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:10.860839 (+ 542us) server_negotiation.cc:299] Negotiation successful
0806 02:20:10.861005 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 02:20:10.862329 14411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:10.847083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:51575)
0806 02:20:10.847684 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:10.847767 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:10.849773 (+ 2006us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:10.850384 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:10.850391 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:10.850762 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:10.851260 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:10.851273 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:10.852116 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:10.852119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:10.853435 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:10.853450 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:10.854370 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:10.854377 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:10.854624 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:10.855332 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:10.855349 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:10.857328 (+ 1979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:10.859200 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:10.859220 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:10.859233 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:10.859490 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:10.859735 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:10.859737 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:10.859738 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:10.859868 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:10.860312 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:10.860317 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:10.860550 (+ 233us) client_negotiation.cc:769] Sending connection context
0806 02:20:10.860753 (+ 203us) client_negotiation.cc:240] Negotiation successful
0806 02:20:10.861074 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":149,"threads_started":1}
I20260806 02:20:10.863667 14409 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39557
I20260806 02:20:10.863984 14409 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:10.864630 14409 heartbeater.cc:511] Master 127.26.189.190:39557 requested a full tablet report, sending...
I20260806 02:20:10.866568 14154 ts_manager.cc:194] Registered new tserver with Master: c0d526359ccd43f182b33b4c92fb94a4 (127.26.189.129:44879)
I20260806 02:20:10.868376 14154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:51575
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:20:10.880425 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39557
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:10.997140 14414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:10.997419 14414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:10.997464 14414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:11.001403 14414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:11.001474 14414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:11.001596 14414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:20:11.007376 14414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:11.008690 14414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:11.009940 14414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:11.020512 14425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:11.020502 14419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:11.020637 14414 server_base.cc:1034] running on GCE node
W20260806 02:20:11.020502 14422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:11.021278 14414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:11.022166 14414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:11.023347 14414 hybrid_clock.cc:648] HybridClock initialized: now 1785982811023319 us; error 41 us; skew 500 ppm
Aug 06 02:20:11 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:11.026590 14414 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:20:11.027612 14414 webserver.cc:460] Webserver started at http://127.26.189.130:34371/ using document root <none> and password file <none>
I20260806 02:20:11.028286 14414 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:11.028357 14414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:11.028621 14414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:20:11.031078 14414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930"
format_stamp: "Formatted at 2026-08-06 02:20:11 on dist-test-slave-gkw7"
server_key: "e44a310ad7975dd9877ae3cf86d46d1a"
server_key_iv: "0c12db3a10b5e5c0d2f1d01d10d36c31"
server_key_version: "encryptionkey@0"
I20260806 02:20:11.031735 14414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930"
format_stamp: "Formatted at 2026-08-06 02:20:11 on dist-test-slave-gkw7"
server_key: "e44a310ad7975dd9877ae3cf86d46d1a"
server_key_iv: "0c12db3a10b5e5c0d2f1d01d10d36c31"
server_key_version: "encryptionkey@0"
I20260806 02:20:11.036060 14414 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:20:11.038856 14435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:11.040234 14414 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 02:20:11.040337 14414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930"
format_stamp: "Formatted at 2026-08-06 02:20:11 on dist-test-slave-gkw7"
server_key: "e44a310ad7975dd9877ae3cf86d46d1a"
server_key_iv: "0c12db3a10b5e5c0d2f1d01d10d36c31"
server_key_version: "encryptionkey@0"
I20260806 02:20:11.040478 14414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:11.051748 14414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:11.054931 14414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:11.055147 14414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:11.055768 14414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:11.056627 14414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:11.056675 14414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:11.056716 14414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:11.056731 14414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:11.068198 14414 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:43383
I20260806 02:20:11.068224 14590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:43383 every 8 connection(s)
I20260806 02:20:11.069167 14414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:20:11.078855 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 14414
I20260806 02:20:11.079008 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:20:11.079403 27382 external_mini_cluster.cc:1428] Setting key ce601b20fdbd77f3ad50c9e5acfe4730
Aug 06 02:20:11 dist-test-slave-gkw7 krb5kdc[14089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:11.085202 14211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.071174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:60263 (local address 127.26.189.190:39557)
0806 02:20:11.071352 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:11.071357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:11.072271 (+ 914us) server_negotiation.cc:407] Connection header received
0806 02:20:11.073717 (+ 1446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:11.073720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:11.073774 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:11.073857 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:11.075148 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.075719 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.077061 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.077306 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.077397 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.080703 (+ 3306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:11.080706 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:11.080708 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:11.080735 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:11.082659 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:11.083375 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:11.083381 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:11.083384 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:11.083504 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:11.083872 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:11.083878 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:11.083882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:11.084164 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:11.084323 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:11.084869 (+ 546us) server_negotiation.cc:299] Negotiation successful
0806 02:20:11.085005 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 02:20:11.086148 14593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.071599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:60263)
0806 02:20:11.072103 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:11.072151 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:11.073425 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:11.074071 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:11.074079 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:11.074492 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:11.074987 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.075001 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.075872 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.075875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.076919 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.076930 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.077471 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.077474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.077680 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.078438 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:11.078458 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:11.080513 (+ 2055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:11.082797 (+ 2284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:11.082807 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:11.082828 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:11.083237 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:11.083614 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:11.083617 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:11.083618 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:11.083773 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:11.084325 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:11.084330 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:11.084587 (+ 257us) client_negotiation.cc:769] Sending connection context
0806 02:20:11.084818 (+ 231us) client_negotiation.cc:240] Negotiation successful
0806 02:20:11.085169 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":128,"threads_started":1}
I20260806 02:20:11.087553 14591 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39557
I20260806 02:20:11.087845 14591 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:11.088579 14591 heartbeater.cc:511] Master 127.26.189.190:39557 requested a full tablet report, sending...
I20260806 02:20:11.089905 14154 ts_manager.cc:194] Registered new tserver with Master: 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383)
I20260806 02:20:11.090515 14154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:60263
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:20:11.113626 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39557
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:11.236038 14597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:11.236307 14597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:11.236352 14597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:11.240239 14597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:11.240305 14597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:11.240365 14597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:20:11.245838 14597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:39557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:11.246897 14597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:11.247913 14597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:11.257926 14611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:11.258057 14597 server_base.cc:1034] running on GCE node
W20260806 02:20:11.257946 14614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:11.257972 14612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:11.258612 14597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:11.259286 14597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:11.260492 14597 hybrid_clock.cc:648] HybridClock initialized: now 1785982811260470 us; error 32 us; skew 500 ppm
Aug 06 02:20:11 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:11.263571 14597 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:20:11.264459 14597 webserver.cc:460] Webserver started at http://127.26.189.131:40555/ using document root <none> and password file <none>
I20260806 02:20:11.264993 14597 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:11.265059 14597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:11.265239 14597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:20:11.267329 14597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "2dc002f339d1483485751dec13a5acc7"
format_stamp: "Formatted at 2026-08-06 02:20:11 on dist-test-slave-gkw7"
server_key: "350aa10103ee0c462a73c3ef7423b504"
server_key_iv: "860efdb6694df2630ba3546b98d0ebec"
server_key_version: "encryptionkey@0"
I20260806 02:20:11.267845 14597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "2dc002f339d1483485751dec13a5acc7"
format_stamp: "Formatted at 2026-08-06 02:20:11 on dist-test-slave-gkw7"
server_key: "350aa10103ee0c462a73c3ef7423b504"
server_key_iv: "860efdb6694df2630ba3546b98d0ebec"
server_key_version: "encryptionkey@0"
I20260806 02:20:11.271845 14597 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:20:11.276726 14621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:11.278538 14597 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260806 02:20:11.278712 14597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "2dc002f339d1483485751dec13a5acc7"
format_stamp: "Formatted at 2026-08-06 02:20:11 on dist-test-slave-gkw7"
server_key: "350aa10103ee0c462a73c3ef7423b504"
server_key_iv: "860efdb6694df2630ba3546b98d0ebec"
server_key_version: "encryptionkey@0"
I20260806 02:20:11.278858 14597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:11.292474 14597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:11.296036 14597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:11.296193 14597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:11.296741 14597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:11.297605 14597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:11.297658 14597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:11.297701 14597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:11.297722 14597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:11.306524 14597 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:44305
I20260806 02:20:11.306591 14780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:44305 every 8 connection(s)
I20260806 02:20:11.307488 14597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:20:11.312307 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 14597
I20260806 02:20:11.312434 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:20:11.312753 27382 external_mini_cluster.cc:1428] Setting key 1f208b2b29c4266c0059e9c55e099f2e
Aug 06 02:20:11 dist-test-slave-gkw7 krb5kdc[14089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:11.322244 14211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.309445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:35053 (local address 127.26.189.190:39557)
0806 02:20:11.309627 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:11.309633 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:11.310558 (+ 925us) server_negotiation.cc:407] Connection header received
0806 02:20:11.311989 (+ 1431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:11.311992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:11.312040 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:11.312127 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:11.313752 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.314450 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.315697 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.315924 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.316040 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.318792 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:11.318795 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:11.318797 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:11.318820 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:11.320176 (+ 1356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:11.320666 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:11.320668 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:11.320670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:11.320751 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:11.321053 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:11.321056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:11.321057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:11.321263 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:11.321340 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:11.321954 (+ 614us) server_negotiation.cc:299] Negotiation successful
0806 02:20:11.322097 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:20:11.323062 14784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.309921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:35053)
0806 02:20:11.310403 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:11.310447 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:11.311782 (+ 1335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:11.312349 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:11.312361 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:11.312881 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:11.313571 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.313595 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.314578 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.314602 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.315565 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.315575 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.316076 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.316080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.316251 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.316857 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:11.316874 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:11.318586 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:11.320295 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:11.320300 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:11.320312 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:11.320567 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:11.320827 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:11.320829 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:11.320830 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:11.320961 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:11.321374 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:11.321380 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:11.321715 (+ 335us) client_negotiation.cc:769] Sending connection context
0806 02:20:11.321886 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 02:20:11.322153 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":132,"threads_started":1}
I20260806 02:20:11.324198 14781 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39557
I20260806 02:20:11.324461 14781 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:11.324960 14781 heartbeater.cc:511] Master 127.26.189.190:39557 requested a full tablet report, sending...
I20260806 02:20:11.326145 14153 ts_manager.cc:194] Registered new tserver with Master: 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305)
I20260806 02:20:11.326967 14153 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:35053
I20260806 02:20:11.327026 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:20:11.337044 14211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.329364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60510 (local address 127.26.189.190:39557)
0806 02:20:11.329491 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:11.329495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:11.329713 (+ 218us) server_negotiation.cc:407] Connection header received
0806 02:20:11.329863 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:11.329865 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:11.329902 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:11.329984 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:11.330704 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.331208 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.332054 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.332282 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.332394 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.333785 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:11.333789 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:11.333792 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:11.333822 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:11.335280 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:11.335737 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:11.335740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:11.335742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:11.335827 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:11.336111 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:11.336114 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:11.336123 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:11.336344 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:11.336490 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:11.336747 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 02:20:11.336862 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 02:20:11.340178 14153 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60510:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:20:11.343251 14153 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:20:11.359275 14801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.353573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46356 (local address 127.26.189.129:44879)
0806 02:20:11.353993 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:11.354010 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:11.354214 (+ 204us) server_negotiation.cc:407] Connection header received
0806 02:20:11.354305 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:11.354310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:11.354506 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:11.354676 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:11.355526 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.356677 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.357966 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.358681 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.358803 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.358928 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:11.359034 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 02:20:11.359128 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":87,"threads_started":1}
I20260806 02:20:11.359270 14797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.352078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:44305 (local address 127.0.0.1:41034)
0806 02:20:11.353661 (+ 1583us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:11.353718 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:11.353864 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:11.354846 (+ 982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:11.354849 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:11.354878 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:11.355098 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.355106 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.356397 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.356403 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.357202 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.357211 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.358339 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.358343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.358776 (+ 433us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.358826 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 02:20:11.358934 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 02:20:11.359067 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1348,"mutex_wait_us":81,"spinlock_wait_cycles":15360,"thread_start_us":112,"threads_started":1}
I20260806 02:20:11.359287 14796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.353286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:44879 (local address 127.0.0.1:46356)
0806 02:20:11.354103 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:11.354117 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:11.354202 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:11.354846 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:11.354849 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:11.354875 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:11.355389 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.355398 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.356826 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.356829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.357847 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.357855 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.358780 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.358783 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.358886 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.358922 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 02:20:11.358993 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 02:20:11.359074 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":759,"mutex_wait_us":63,"spinlock_wait_cycles":1792,"thread_start_us":101,"threads_started":1}
I20260806 02:20:11.359543 14800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.352086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:43383 (local address 127.0.0.1:51918)
0806 02:20:11.353663 (+ 1577us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:11.353718 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:11.353864 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:11.354516 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:11.354521 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:11.354544 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:11.354703 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.354710 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.356078 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.356082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.357385 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.357396 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.358583 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.358587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.359165 (+ 578us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.359191 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 02:20:11.359263 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 02:20:11.359333 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1480,"mutex_wait_us":417,"thread_start_us":105,"threads_started":1}
I20260806 02:20:11.359692 14799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.353061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51918 (local address 127.26.189.130:43383)
0806 02:20:11.353686 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:11.353701 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:11.353822 (+ 121us) server_negotiation.cc:407] Connection header received
0806 02:20:11.354083 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:11.354090 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:11.354334 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:11.354515 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:11.354835 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.355926 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.357509 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.358322 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.358428 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.358528 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:11.359420 (+ 892us) server_negotiation.cc:299] Negotiation successful
0806 02:20:11.359518 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":142,"threads_started":1}
I20260806 02:20:11.360838 14798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.352375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41034 (local address 127.26.189.131:44305)
0806 02:20:11.354204 (+ 1829us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:11.354216 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:11.354235 (+ 19us) server_negotiation.cc:407] Connection header received
0806 02:20:11.354304 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:11.354310 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:11.354506 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:11.354676 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:11.355232 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.356271 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.357329 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.358210 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.358346 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.358499 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:11.360588 (+ 2089us) server_negotiation.cc:299] Negotiation successful
0806 02:20:11.360685 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1705,"thread_start_us":171,"threads_started":1}
I20260806 02:20:11.363077 14500 tablet_service.cc:1467] Processing CreateTablet for tablet d18ab214a30b499dad614a3381b10a5c (DEFAULT_TABLE table=test-table [id=378e2dd6846d419d804e4d3093b53536]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:11.363065 14325 tablet_service.cc:1467] Processing CreateTablet for tablet d18ab214a30b499dad614a3381b10a5c (DEFAULT_TABLE table=test-table [id=378e2dd6846d419d804e4d3093b53536]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:11.363571 14691 tablet_service.cc:1467] Processing CreateTablet for tablet d18ab214a30b499dad614a3381b10a5c (DEFAULT_TABLE table=test-table [id=378e2dd6846d419d804e4d3093b53536]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:11.364296 14500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d18ab214a30b499dad614a3381b10a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:11.364295 14325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d18ab214a30b499dad614a3381b10a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:11.364564 14691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d18ab214a30b499dad614a3381b10a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:11.370726 14802 tablet_bootstrap.cc:492] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7: Bootstrap starting.
I20260806 02:20:11.372303 14809 tablet_bootstrap.cc:492] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930: Bootstrap starting.
I20260806 02:20:11.373703 14802 tablet_bootstrap.cc:654] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:11.373848 14804 tablet_bootstrap.cc:492] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Bootstrap starting.
I20260806 02:20:11.374516 14802 log.cc:824] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:11.375031 14809 tablet_bootstrap.cc:654] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:11.375882 14809 log.cc:824] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:11.376087 14804 tablet_bootstrap.cc:654] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:11.376579 14802 tablet_bootstrap.cc:492] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7: No bootstrap required, opened a new log
I20260806 02:20:11.376804 14802 ts_tablet_manager.cc:1397] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260806 02:20:11.376893 14804 log.cc:824] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:11.378120 14809 tablet_bootstrap.cc:492] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930: No bootstrap required, opened a new log
I20260806 02:20:11.378322 14809 ts_tablet_manager.cc:1397] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:20:11.378943 14804 tablet_bootstrap.cc:492] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: No bootstrap required, opened a new log
I20260806 02:20:11.379129 14804 ts_tablet_manager.cc:1397] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 02:20:11.380446 14802 raft_consensus.cc:348] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:11.380748 14802 raft_consensus.cc:374] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:11.380805 14802 raft_consensus.cc:729] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc002f339d1483485751dec13a5acc7, State: Initialized, Role: FOLLOWER
I20260806 02:20:11.381264 14802 consensus_queue.cc:260] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:11.381942 14781 heartbeater.cc:503] Master 127.26.189.190:39557 was elected leader, sending a full tablet report...
I20260806 02:20:11.382323 14802 ts_tablet_manager.cc:1428] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260806 02:20:11.382318 14809 raft_consensus.cc:348] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:11.382556 14809 raft_consensus.cc:374] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:11.382617 14809 raft_consensus.cc:729] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e8a90d6d7a643d6b8ebe0b9becbb930, State: Initialized, Role: FOLLOWER
I20260806 02:20:11.383078 14809 consensus_queue.cc:260] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:11.383489 14804 raft_consensus.cc:348] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:11.383745 14804 raft_consensus.cc:374] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:11.383770 14591 heartbeater.cc:503] Master 127.26.189.190:39557 was elected leader, sending a full tablet report...
I20260806 02:20:11.383821 14804 raft_consensus.cc:729] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d526359ccd43f182b33b4c92fb94a4, State: Initialized, Role: FOLLOWER
I20260806 02:20:11.384239 14804 consensus_queue.cc:260] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:11.384944 14409 heartbeater.cc:503] Master 127.26.189.190:39557 was elected leader, sending a full tablet report...
I20260806 02:20:11.385251 14804 ts_tablet_manager.cc:1428] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 02:20:11.386627 14809 ts_tablet_manager.cc:1428] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
W20260806 02:20:11.558588 14782 tablet.cc:2369] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 02:20:11.570601 14592 tablet.cc:2369] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:20:11.581079 14815 raft_consensus.cc:482] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:11.581353 14815 raft_consensus.cc:504] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:11.582691 14815 leader_election.cc:288] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383), c0d526359ccd43f182b33b4c92fb94a4 (127.26.189.129:44879)
I20260806 02:20:11.587204 14801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.583084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:38709 (local address 127.26.189.129:44879)
0806 02:20:11.583210 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:11.583216 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:11.583234 (+ 18us) server_negotiation.cc:407] Connection header received
0806 02:20:11.583423 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:11.583428 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:11.583488 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:11.583601 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:11.583974 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.584759 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.586047 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.586611 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.586758 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.586819 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:11.587004 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 02:20:11.587074 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 02:20:11.587204 14784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.582970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:44879 (local address 127.26.189.131:38709)
0806 02:20:11.583106 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:11.583123 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:11.583273 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:11.583665 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:11.583671 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:11.583695 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:11.583840 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.583850 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.584879 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.584882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.585920 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.585930 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.586741 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.586745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.586862 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.586885 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 02:20:11.586987 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 02:20:11.587066 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":1}
I20260806 02:20:11.587343 14799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.583085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:35603 (local address 127.26.189.130:43383)
0806 02:20:11.583210 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:11.583215 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:11.583689 (+ 474us) server_negotiation.cc:407] Connection header received
0806 02:20:11.583755 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:11.583758 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:11.583817 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:11.583919 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:11.584237 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.584941 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.586123 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.586649 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.586784 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.586839 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:11.587100 (+ 261us) server_negotiation.cc:299] Negotiation successful
0806 02:20:11.587179 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 02:20:11.587596 14818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.582970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:43383 (local address 127.26.189.131:35603)
0806 02:20:11.583555 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:11.583572 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:11.583674 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:11.583945 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:11.583951 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:11.583970 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:11.584092 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.584098 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.585067 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.585074 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.585958 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:11.585968 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.586895 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.586898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:11.586976 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.586993 (+ 17us) client_negotiation.cc:769] Sending connection context
0806 02:20:11.587081 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 02:20:11.587156 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":175,"thread_start_us":157,"threads_started":1}
I20260806 02:20:11.588117 14349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d18ab214a30b499dad614a3381b10a5c" candidate_uuid: "2dc002f339d1483485751dec13a5acc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d526359ccd43f182b33b4c92fb94a4" is_pre_election: true
I20260806 02:20:11.588240 14525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d18ab214a30b499dad614a3381b10a5c" candidate_uuid: "2dc002f339d1483485751dec13a5acc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" is_pre_election: true
I20260806 02:20:11.588487 14525 raft_consensus.cc:2454] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc002f339d1483485751dec13a5acc7 in term 0.
I20260806 02:20:11.588488 14349 raft_consensus.cc:2454] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc002f339d1483485751dec13a5acc7 in term 0.
I20260806 02:20:11.589013 14627 leader_election.cc:302] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc002f339d1483485751dec13a5acc7, 5e8a90d6d7a643d6b8ebe0b9becbb930; no voters:
I20260806 02:20:11.589293 14815 raft_consensus.cc:2781] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:20:11.589380 14815 raft_consensus.cc:482] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:20:11.589424 14815 raft_consensus.cc:3037] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:11.590519 14815 raft_consensus.cc:504] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:11.590889 14815 leader_election.cc:288] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [CANDIDATE]: Term 1 election: Requested vote from peers 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383), c0d526359ccd43f182b33b4c92fb94a4 (127.26.189.129:44879)
I20260806 02:20:11.591281 14525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d18ab214a30b499dad614a3381b10a5c" candidate_uuid: "2dc002f339d1483485751dec13a5acc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930"
I20260806 02:20:11.591403 14525 raft_consensus.cc:3037] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:11.591428 14349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d18ab214a30b499dad614a3381b10a5c" candidate_uuid: "2dc002f339d1483485751dec13a5acc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d526359ccd43f182b33b4c92fb94a4"
I20260806 02:20:11.591595 14349 raft_consensus.cc:3037] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:11.592684 14525 raft_consensus.cc:2454] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc002f339d1483485751dec13a5acc7 in term 1.
I20260806 02:20:11.592904 14349 raft_consensus.cc:2454] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc002f339d1483485751dec13a5acc7 in term 1.
I20260806 02:20:11.593008 14627 leader_election.cc:302] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc002f339d1483485751dec13a5acc7, 5e8a90d6d7a643d6b8ebe0b9becbb930; no voters:
I20260806 02:20:11.593191 14815 raft_consensus.cc:2781] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:20:11.593437 14815 raft_consensus.cc:686] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 1 LEADER]: Becoming Leader. State: Replica: 2dc002f339d1483485751dec13a5acc7, State: Running, Role: LEADER
I20260806 02:20:11.593819 14815 consensus_queue.cc:237] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
W20260806 02:20:11.595943 14410 tablet.cc:2369] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:20:11.597417 14154 catalog_manager.cc:5495] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dc002f339d1483485751dec13a5acc7 (127.26.189.131). New cstate: current_term: 1 leader_uuid: "2dc002f339d1483485751dec13a5acc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } health_report { overall_health: UNKNOWN } } }
I20260806 02:20:11.651861 14798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.647982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41040 (local address 127.26.189.131:44305)
0806 02:20:11.648140 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:11.648144 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:11.648165 (+ 21us) server_negotiation.cc:407] Connection header received
0806 02:20:11.648251 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:11.648254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:11.648325 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:11.648424 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:20:11.648744 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.649276 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.650272 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:11.650534 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:11.650629 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:11.650918 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:20:11.651420 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:20:11.651523 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:11.651655 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 02:20:11.651720 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 02:20:11.658547 14525 raft_consensus.cc:1261] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 1 FOLLOWER]: Refusing update from remote peer 2dc002f339d1483485751dec13a5acc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:20:11.658586 14349 raft_consensus.cc:1261] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Refusing update from remote peer 2dc002f339d1483485751dec13a5acc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:20:11.659390 14820 consensus_queue.cc:1035] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:20:11.659595 14815 consensus_queue.cc:1035] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:20:11.667799 14825 mvcc.cc:205] Tried to move back new op lower bound from 7315385596545323008 to 7315385596291194880. Current Snapshot: MvccSnapshot[applied={T|T < 7315385596545323008}]
I20260806 02:20:11.671201 14826 mvcc.cc:205] Tried to move back new op lower bound from 7315385596545323008 to 7315385596291194880. Current Snapshot: MvccSnapshot[applied={T|T < 7315385596545323008}]
I20260806 02:20:11.675851 14154 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:20:11.676047 14154 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:20:11.678879 14154 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Sending DeleteTablet for 3 replicas of tablet d18ab214a30b499dad614a3381b10a5c
I20260806 02:20:11.679803 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 14240
I20260806 02:20:11.679847 14325 tablet_service.cc:1514] Processing DeleteTablet for tablet d18ab214a30b499dad614a3381b10a5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:11 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:46356
I20260806 02:20:11.679805 14500 tablet_service.cc:1514] Processing DeleteTablet for tablet d18ab214a30b499dad614a3381b10a5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:11 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:51918
I20260806 02:20:11.680670 14691 tablet_service.cc:1514] Processing DeleteTablet for tablet d18ab214a30b499dad614a3381b10a5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:11 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:41034
I20260806 02:20:11.686103 14834 tablet_replica.cc:330] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930: stopping tablet replica
I20260806 02:20:11.686568 14834 raft_consensus.cc:2229] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:20:11.687003 14834 raft_consensus.cc:2258] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:11.687507 14835 tablet_replica.cc:330] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7: stopping tablet replica
I20260806 02:20:11.687922 14835 raft_consensus.cc:2229] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:20:11.688402 14835 raft_consensus.cc:2258] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:11.689266 14834 ts_tablet_manager.cc:1905] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:20:11.692943 14835 ts_tablet_manager.cc:1905] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:20:11.694391 14834 ts_tablet_manager.cc:1918] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:20:11.694526 14834 log.cc:1196] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/d18ab214a30b499dad614a3381b10a5c
I20260806 02:20:11.694916 14834 ts_tablet_manager.cc:1939] T d18ab214a30b499dad614a3381b10a5c P 5e8a90d6d7a643d6b8ebe0b9becbb930: Deleting consensus metadata
I20260806 02:20:11.695813 14835 ts_tablet_manager.cc:1918] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:20:11.695930 14835 log.cc:1196] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/d18ab214a30b499dad614a3381b10a5c
I20260806 02:20:11.696276 14835 ts_tablet_manager.cc:1939] T d18ab214a30b499dad614a3381b10a5c P 2dc002f339d1483485751dec13a5acc7: Deleting consensus metadata
I20260806 02:20:11.696564 14138 catalog_manager.cc:4841] TS 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383): tablet d18ab214a30b499dad614a3381b10a5c (table test-table [id=378e2dd6846d419d804e4d3093b53536]) successfully deleted
I20260806 02:20:11.697809 14136 catalog_manager.cc:4841] TS 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305): tablet d18ab214a30b499dad614a3381b10a5c (table test-table [id=378e2dd6846d419d804e4d3093b53536]) successfully deleted
W20260806 02:20:11.699815 14136 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:44879 (error 108)
I20260806 02:20:11.699858 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 14414
I20260806 02:20:11.705901 14797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:11.705130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:44879 (local address 127.0.0.1:46364)
0806 02:20:11.705697 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:11.705787 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:44879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 02:20:11.706804 14136 catalog_manager.cc:4584] TS c0d526359ccd43f182b33b4c92fb94a4 (127.26.189.129:44879): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d18ab214a30b499dad614a3381b10a5c: Network error: Client connection negotiation failed: client connection to 127.26.189.129:44879: connect: Connection refused (error 111)
I20260806 02:20:11.713012 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 14597
I20260806 02:20:11.729259 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 14112
I20260806 02:20:11.743108 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39557
--webserver_interface=127.26.189.190
--webserver_port=43441
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:39557
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:11.862192 14837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:11.862485 14837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:11.862529 14837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:11.866578 14837 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:20:11.866643 14837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:11.866667 14837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:11.866683 14837 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:20:11.866698 14837 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:20:11.872131 14837 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:39557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=43441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:11.873208 14837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:11.874325 14837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:11.888942 14845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:11.888933 14848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:11.888933 14844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:11.889194 14837 server_base.cc:1034] running on GCE node
I20260806 02:20:11.890084 14837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:11.891327 14837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:11.892531 14837 hybrid_clock.cc:648] HybridClock initialized: now 1785982811892511 us; error 31 us; skew 500 ppm
Aug 06 02:20:11 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:11.895649 14837 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:20:11.896633 14837 webserver.cc:460] Webserver started at http://127.26.189.190:43441/ using document root <none> and password file <none>
I20260806 02:20:11.897312 14837 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:11.897435 14837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:11.901641 14837 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:20:11.903877 14859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:11.905200 14837 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:20:11.905354 14837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "2e17fa9520b340bb95215aa07afb72a6"
format_stamp: "Formatted at 2026-08-06 02:20:10 on dist-test-slave-gkw7"
server_key: "54ec62cd5b172f54a2debabfb7e431b8"
server_key_iv: "dd86cf09f6c92f88fb034dc2d9b447e3"
server_key_version: "encryptionkey@0"
I20260806 02:20:11.906059 14837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:11.920380 14837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:11.923949 14837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:11.924171 14837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:11.932224 14837 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:39557
I20260806 02:20:11.932554 14932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:39557 every 8 connection(s)
I20260806 02:20:11.933429 14837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:20:11.938112 14933 sys_catalog.cc:263] Verifying existing consensus state
I20260806 02:20:11.939816 14933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Bootstrap starting.
I20260806 02:20:11.941200 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 14837
I20260806 02:20:11.941756 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:44879
--local_ip_for_outbound_sockets=127.26.189.129
--tserver_master_addrs=127.26.189.190:39557
--webserver_port=46055
--webserver_interface=127.26.189.129
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:20:11.959671 14933 log.cc:824] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:11.969722 14933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 02:20:11.970178 14933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Bootstrap complete.
I20260806 02:20:11.974975 14933 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } }
I20260806 02:20:11.975454 14933 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e17fa9520b340bb95215aa07afb72a6, State: Initialized, Role: FOLLOWER
I20260806 02:20:11.976150 14933 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } }
I20260806 02:20:11.976293 14933 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:20:11.976401 14933 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:20:11.976533 14933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 1 FOLLOWER]: Advancing to term 2
I20260806 02:20:11.978935 14933 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } }
I20260806 02:20:11.979336 14933 leader_election.cc:302] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e17fa9520b340bb95215aa07afb72a6; no voters:
I20260806 02:20:11.979738 14933 leader_election.cc:288] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 02:20:11.979914 14941 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 02:20:11.980214 14941 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 2 LEADER]: Becoming Leader. State: Replica: 2e17fa9520b340bb95215aa07afb72a6, State: Running, Role: LEADER
I20260806 02:20:11.980571 14941 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } }
I20260806 02:20:11.981173 14933 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:20:11.982208 14942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2e17fa9520b340bb95215aa07afb72a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } } }
I20260806 02:20:11.982388 14942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:11.983166 14944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e17fa9520b340bb95215aa07afb72a6. Latest consensus state: current_term: 2 leader_uuid: "2e17fa9520b340bb95215aa07afb72a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } } }
I20260806 02:20:11.983273 14944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:11.983546 14953 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:20:11.989089 14953 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:20:11.989845 14953 catalog_manager.cc:1259] Loaded cluster ID: 7c1f2b1eebc747f799ac3f3b357ca94b
I20260806 02:20:11.989914 14953 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:20:11.991464 14953 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 02:20:11.996673 14953 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 02:20:12.002851 14953 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:20:12.003744 14953 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Loaded TSK: 0
I20260806 02:20:12.005105 14953 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 02:20:12.074193 14938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:12.074463 14938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:12.074509 14938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:12.078675 14938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:12.078745 14938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:12.078855 14938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:20:12.084760 14938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:44879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=46055
--tserver_master_addrs=127.26.189.190:39557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:12.085942 14938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:12.086987 14938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:12.098107 14971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:12.098129 14973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:12.098119 14970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:12.098482 14938 server_base.cc:1034] running on GCE node
I20260806 02:20:12.099036 14938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:12.099799 14938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:12.100996 14938 hybrid_clock.cc:648] HybridClock initialized: now 1785982812100964 us; error 52 us; skew 500 ppm
Aug 06 02:20:12 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:12.104106 14938 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:20:12.105109 14938 webserver.cc:460] Webserver started at http://127.26.189.129:46055/ using document root <none> and password file <none>
I20260806 02:20:12.105779 14938 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:12.105862 14938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:12.110144 14938 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:12.112452 14983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:12.113894 14938 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:12.114020 14938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "c0d526359ccd43f182b33b4c92fb94a4"
format_stamp: "Formatted at 2026-08-06 02:20:10 on dist-test-slave-gkw7"
server_key: "bfa93e3ddaa260f21199e51f343627af"
server_key_iv: "96cabbbae4e0494c5ac560543971f41a"
server_key_version: "encryptionkey@0"
I20260806 02:20:12.114604 14938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:12.145313 14938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:12.148931 14938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:12.149175 14938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:12.149881 14938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:12.151121 14995 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 02:20:12.155632 14938 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 02:20:12.155706 14938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260806 02:20:12.155795 14938 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 02:20:12.157711 14938 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 02:20:12.157758 14938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260806 02:20:12.158057 14995 tablet_bootstrap.cc:492] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Bootstrap starting.
I20260806 02:20:12.169085 14938 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:44879
I20260806 02:20:12.169159 15143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:44879 every 8 connection(s)
I20260806 02:20:12.170127 14938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:20:12.170699 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 14938
I20260806 02:20:12.171181 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:43383
--local_ip_for_outbound_sockets=127.26.189.130
--tserver_master_addrs=127.26.189.190:39557
--webserver_port=34371
--webserver_interface=127.26.189.130
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:20:12.178544 14995 log.cc:824] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Log is configured to *not* fsync() on all Append() calls
Aug 06 02:20:12 dist-test-slave-gkw7 krb5kdc[14089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:12.188311 15148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.172402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:52859)
0806 02:20:12.173200 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:12.173255 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:12.174150 (+ 895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:12.175279 (+ 1129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:12.175287 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:12.175730 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:12.176188 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.176202 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.177516 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.177522 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.179042 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.179058 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.180060 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.180064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.180261 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.180944 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:12.180961 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:12.182759 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:12.185081 (+ 2322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:12.185087 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:12.185099 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:12.185367 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:12.185800 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:12.185803 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:12.185805 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:12.185956 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:12.186549 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:12.186556 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:12.186809 (+ 253us) client_negotiation.cc:769] Sending connection context
0806 02:20:12.186987 (+ 178us) client_negotiation.cc:240] Negotiation successful
0806 02:20:12.187351 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":150,"threads_started":1}
I20260806 02:20:12.188294 15147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.172393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:52859 (local address 127.26.189.190:39557)
0806 02:20:12.172911 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:12.172931 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:12.173628 (+ 697us) server_negotiation.cc:407] Connection header received
0806 02:20:12.174575 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:12.174586 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:12.174883 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:12.175229 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:12.176374 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.177364 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.179203 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.179904 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.180186 (+ 282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.182966 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:12.182972 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:12.182994 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:12.183024 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:12.184922 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:12.185507 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:12.185512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:12.185516 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:12.185696 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:12.186062 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:12.186065 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:12.186067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:12.186426 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:12.186587 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:12.187128 (+ 541us) server_negotiation.cc:299] Negotiation successful
0806 02:20:12.187399 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":114,"threads_started":1}
I20260806 02:20:12.189051 14995 tablet_bootstrap.cc:492] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 02:20:12.189494 14995 tablet_bootstrap.cc:492] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Bootstrap complete.
I20260806 02:20:12.191082 15144 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39557
I20260806 02:20:12.191152 14995 ts_tablet_manager.cc:1397] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Time spent bootstrapping tablet: real 0.033s user 0.017s sys 0.014s
I20260806 02:20:12.191339 15144 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:12.191854 15144 heartbeater.cc:511] Master 127.26.189.190:39557 requested a full tablet report, sending...
I20260806 02:20:12.194309 14879 ts_manager.cc:194] Registered new tserver with Master: c0d526359ccd43f182b33b4c92fb94a4 (127.26.189.129:44879)
I20260806 02:20:12.194188 14995 raft_consensus.cc:348] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:12.194715 14995 raft_consensus.cc:729] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d526359ccd43f182b33b4c92fb94a4, State: Initialized, Role: FOLLOWER
I20260806 02:20:12.195209 14995 consensus_queue.cc:260] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:12.196287 14995 ts_tablet_manager.cc:1428] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260806 02:20:12.197986 14879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:52859
I20260806 02:20:12.200512 15144 heartbeater.cc:503] Master 127.26.189.190:39557 was elected leader, sending a full tablet report...
Aug 06 02:20:12 dist-test-slave-gkw7 krb5kdc[14089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.129@KRBTEST.COM
I20260806 02:20:12.209519 15152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.197476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:44879 (local address 127.0.0.1:46376)
0806 02:20:12.198528 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:12.198573 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:12.198720 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:12.199310 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:12.199316 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:12.199760 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:12.199897 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.199905 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.201303 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.201307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.202370 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.202381 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.203155 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.203157 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.203239 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.203843 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:12.203856 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:12.205259 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:12.207569 (+ 2310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:12.207579 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:12.207585 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:12.207906 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:12.208229 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:12.208233 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:12.208235 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:12.208339 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:12.208800 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:12.208807 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:12.208943 (+ 136us) client_negotiation.cc:769] Sending connection context
0806 02:20:12.209097 (+ 154us) client_negotiation.cc:240] Negotiation successful
0806 02:20:12.209332 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":891,"thread_start_us":152,"threads_started":1}
I20260806 02:20:12.209683 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.197609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46376 (local address 127.26.189.129:44879)
0806 02:20:12.198288 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:12.198299 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:12.198850 (+ 551us) server_negotiation.cc:407] Connection header received
0806 02:20:12.198929 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:12.198937 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:12.199139 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:12.199273 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:12.200023 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.201174 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.202501 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.203027 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.203142 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.205467 (+ 2325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:12.205483 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:12.205493 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:12.205533 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:12.207448 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:12.208033 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:12.208037 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:12.208039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:12.208130 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:12.208432 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:12.208435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:12.208436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:12.208683 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:12.208786 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:12.209223 (+ 437us) server_negotiation.cc:299] Negotiation successful
0806 02:20:12.209414 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":93,"threads_started":1}
I20260806 02:20:12.210927 15060 tablet_service.cc:1514] Processing DeleteTablet for tablet d18ab214a30b499dad614a3381b10a5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:11 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:46376
I20260806 02:20:12.211956 15157 tablet_replica.cc:330] stopping tablet replica
I20260806 02:20:12.212275 15157 raft_consensus.cc:2229] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:20:12.212538 15157 raft_consensus.cc:2258] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:12.213510 15157 ts_tablet_manager.cc:1905] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:20:12.217301 15157 ts_tablet_manager.cc:1918] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:20:12.217434 15157 log.cc:1196] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal/wals/d18ab214a30b499dad614a3381b10a5c
I20260806 02:20:12.217767 15157 ts_tablet_manager.cc:1939] T d18ab214a30b499dad614a3381b10a5c P c0d526359ccd43f182b33b4c92fb94a4: Deleting consensus metadata
I20260806 02:20:12.219681 14861 catalog_manager.cc:4841] TS c0d526359ccd43f182b33b4c92fb94a4 (127.26.189.129:44879): tablet d18ab214a30b499dad614a3381b10a5c (table test-table [id=378e2dd6846d419d804e4d3093b53536]) successfully deleted
W20260806 02:20:12.300380 15149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:12.300642 15149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:12.300714 15149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:12.304724 15149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:12.304785 15149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:12.304893 15149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:20:12.310238 15149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:43383
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=34371
--tserver_master_addrs=127.26.189.190:39557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:12.311299 15149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:12.312331 15149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:12.322526 15167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:12.322546 15169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:12.322533 15171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:12.322597 15149 server_base.cc:1034] running on GCE node
I20260806 02:20:12.323192 15149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:12.323843 15149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:12.325039 15149 hybrid_clock.cc:648] HybridClock initialized: now 1785982812325006 us; error 53 us; skew 500 ppm
Aug 06 02:20:12 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:12.327900 15149 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:20:12.328747 15149 webserver.cc:460] Webserver started at http://127.26.189.130:34371/ using document root <none> and password file <none>
I20260806 02:20:12.329339 15149 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:12.329418 15149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:12.333338 15149 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:20:12.335558 15180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:12.336951 15149 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:20:12.337095 15149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930"
format_stamp: "Formatted at 2026-08-06 02:20:11 on dist-test-slave-gkw7"
server_key: "e44a310ad7975dd9877ae3cf86d46d1a"
server_key_iv: "0c12db3a10b5e5c0d2f1d01d10d36c31"
server_key_version: "encryptionkey@0"
I20260806 02:20:12.337731 15149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:12.357616 15149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:12.360901 15149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:12.361112 15149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:12.361835 15149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:12.362715 15149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:12.362774 15149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:12.362816 15149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:12.362871 15149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:12.372012 15149 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:43383
I20260806 02:20:12.372035 15333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:43383 every 8 connection(s)
I20260806 02:20:12.373034 15149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:20:12.373718 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 15149
I20260806 02:20:12.374225 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:44305
--local_ip_for_outbound_sockets=127.26.189.131
--tserver_master_addrs=127.26.189.190:39557
--webserver_port=40555
--webserver_interface=127.26.189.131
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 02:20:12 dist-test-slave-gkw7 krb5kdc[14089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:12.389024 15147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.375210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:54977 (local address 127.26.189.190:39557)
0806 02:20:12.375416 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:12.375424 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:12.376305 (+ 881us) server_negotiation.cc:407] Connection header received
0806 02:20:12.377811 (+ 1506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:12.377817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:12.377886 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:12.377987 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:12.379262 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.380201 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.381445 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.382018 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.382153 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.385180 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:12.385183 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:12.385185 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:12.385211 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:12.386823 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:12.387427 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:12.387430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:12.387432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:12.387511 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:12.387900 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:12.387902 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:12.387903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:12.388088 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:12.388166 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:12.388767 (+ 601us) server_negotiation.cc:299] Negotiation successful
0806 02:20:12.388895 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 02:20:12.390080 15337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.375572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:54977)
0806 02:20:12.376124 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:12.376191 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:12.377518 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:12.378153 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:12.378160 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:12.378530 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:12.379062 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.379086 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.380348 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.380351 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.381318 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.381327 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.382181 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.382184 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.382336 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.382983 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:12.383000 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:12.384966 (+ 1966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:12.386951 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:12.386958 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:12.386975 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:12.387321 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:12.387601 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:12.387604 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:12.387606 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:12.387795 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:12.388187 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:12.388193 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:12.388494 (+ 301us) client_negotiation.cc:769] Sending connection context
0806 02:20:12.388699 (+ 205us) client_negotiation.cc:240] Negotiation successful
0806 02:20:12.389042 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":116,"threads_started":1}
I20260806 02:20:12.391312 15335 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39557
I20260806 02:20:12.391579 15335 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:12.392108 15335 heartbeater.cc:511] Master 127.26.189.190:39557 requested a full tablet report, sending...
I20260806 02:20:12.393237 14879 ts_manager.cc:194] Registered new tserver with Master: 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383)
I20260806 02:20:12.393893 14879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:54977
W20260806 02:20:12.493208 15338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:12.493528 15338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:12.493636 15338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:12.497895 15338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:12.497990 15338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:12.498091 15338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:20:12.503851 15338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:44305
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=40555
--tserver_master_addrs=127.26.189.190:39557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:12.505327 15338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:12.506630 15338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:12.517400 15348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:12.517421 15344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:12.517716 15338 server_base.cc:1034] running on GCE node
W20260806 02:20:12.517445 15346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:12.518340 15338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:12.519104 15338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:12.520325 15338 hybrid_clock.cc:648] HybridClock initialized: now 1785982812520314 us; error 28 us; skew 500 ppm
Aug 06 02:20:12 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:12.523319 15338 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:20:12.524164 15338 webserver.cc:460] Webserver started at http://127.26.189.131:40555/ using document root <none> and password file <none>
I20260806 02:20:12.524698 15338 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:12.524773 15338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:12.528815 15338 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:20:12.530938 15355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:12.532292 15338 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 02:20:12.532393 15338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "2dc002f339d1483485751dec13a5acc7"
format_stamp: "Formatted at 2026-08-06 02:20:11 on dist-test-slave-gkw7"
server_key: "350aa10103ee0c462a73c3ef7423b504"
server_key_iv: "860efdb6694df2630ba3546b98d0ebec"
server_key_version: "encryptionkey@0"
I20260806 02:20:12.532974 15338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:12.546150 15338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:12.549753 15338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:12.549968 15338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:12.550619 15338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:12.551518 15338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:12.551566 15338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:12.551632 15338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:12.551672 15338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:12.561292 15517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:44305 every 8 connection(s)
I20260806 02:20:12.561293 15338 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:44305
I20260806 02:20:12.562526 15338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
Aug 06 02:20:12 dist-test-slave-gkw7 krb5kdc[14089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:12.572417 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 15338
I20260806 02:20:12.576682 15147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.564515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:33657 (local address 127.26.189.190:39557)
0806 02:20:12.564676 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:12.564680 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:12.565791 (+ 1111us) server_negotiation.cc:407] Connection header received
0806 02:20:12.566667 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:12.566669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:12.566717 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:12.566799 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:12.568006 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.568557 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.569784 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.570007 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.570088 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.572924 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:12.572927 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:12.572929 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:12.572953 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:12.574569 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:12.575105 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:12.575109 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:12.575111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:12.575204 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:12.575573 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:12.575577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:12.575579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:12.575762 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:12.575870 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:12.576389 (+ 519us) server_negotiation.cc:299] Negotiation successful
0806 02:20:12.576510 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 02:20:12.577786 15521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.564904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:33657)
0806 02:20:12.565623 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:12.565666 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:12.566469 (+ 803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:12.566970 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:12.566977 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:12.567379 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:12.567868 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.567881 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.568703 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.568706 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.569656 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.569666 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.570213 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.570216 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.570367 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.571050 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:12.571068 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:12.572730 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:12.574696 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:12.574703 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:12.574721 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:12.574994 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:12.575296 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:12.575300 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:12.575302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:12.575455 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:12.575870 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:12.575878 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:12.576142 (+ 264us) client_negotiation.cc:769] Sending connection context
0806 02:20:12.576345 (+ 203us) client_negotiation.cc:240] Negotiation successful
0806 02:20:12.576714 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":119,"threads_started":1}
I20260806 02:20:12.579334 15518 heartbeater.cc:347] Connected to a master server at 127.26.189.190:39557
I20260806 02:20:12.579638 15518 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:12.580303 15518 heartbeater.cc:511] Master 127.26.189.190:39557 requested a full tablet report, sending...
I20260806 02:20:12.581595 14879 ts_manager.cc:194] Registered new tserver with Master: 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305)
I20260806 02:20:12.581954 15522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.573176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60524 (local address 127.26.189.190:39557)
0806 02:20:12.573467 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:12.573471 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:12.573682 (+ 211us) server_negotiation.cc:407] Connection header received
0806 02:20:12.573861 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:12.573864 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:12.573911 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:12.574004 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:12.574738 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.575271 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.576153 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.576396 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.576508 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.578245 (+ 1737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:12.578257 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:12.578259 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:12.578284 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:12.580045 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:12.580588 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:12.580592 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:12.580593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:12.580685 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:12.580992 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:12.580994 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:12.580995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:12.581176 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:12.581455 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:12.581639 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 02:20:12.581770 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":100,"threads_started":1}
I20260806 02:20:12.582470 14879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:33657
I20260806 02:20:12.583851 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:20:12.588402 15522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.584539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60534 (local address 127.26.189.190:39557)
0806 02:20:12.584683 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:12.584687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:12.584882 (+ 195us) server_negotiation.cc:407] Connection header received
0806 02:20:12.585065 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:12.585068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:12.585159 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:12.585271 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:20:12.585516 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.586060 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.586976 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.587208 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.587316 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.587639 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:20:12.587999 (+ 360us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:20:12.588134 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:12.588204 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 02:20:12.588261 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 02:20:12.589048 14879 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:60534:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:20:12.592483 14879 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:20:12.601729 15060 tablet_service.cc:1467] Processing CreateTablet for tablet 394b7bc14f314dd683d4c31bee7c40ea (DEFAULT_TABLE table=test-table [id=08d9b1b58e274f8e9e26fb5e424596f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:12.602512 15060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394b7bc14f314dd683d4c31bee7c40ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:12.605688 14995 tablet_bootstrap.cc:492] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: Bootstrap starting.
I20260806 02:20:12.606181 15152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.600082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:43383 (local address 127.0.0.1:51928)
0806 02:20:12.600208 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:12.600225 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:12.600316 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:12.601217 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:12.601220 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:12.601240 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:12.601360 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.601370 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.603168 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.603174 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.604491 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.604504 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.605716 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.605722 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.605841 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.605900 (+ 59us) client_negotiation.cc:769] Sending connection context
0806 02:20:12.605954 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 02:20:12.606046 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":64}
I20260806 02:20:12.606467 15530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.600350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:44305 (local address 127.0.0.1:41042)
0806 02:20:12.601101 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:12.601116 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:12.601211 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:12.601998 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:12.602001 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:12.602021 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:12.602114 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.602120 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.603564 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.603567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.604442 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.604452 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.606058 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.606062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.606158 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.606182 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 02:20:12.606264 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 02:20:12.606335 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"mutex_wait_us":43,"thread_start_us":106,"threads_started":1}
I20260806 02:20:12.606603 15531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.600548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41042 (local address 127.26.189.131:44305)
0806 02:20:12.600946 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:12.600957 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:12.601311 (+ 354us) server_negotiation.cc:407] Connection header received
0806 02:20:12.601395 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:12.601400 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:12.601623 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:12.601810 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:12.602256 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.603426 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.604570 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.605731 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.605856 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.605990 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:12.606333 (+ 343us) server_negotiation.cc:299] Negotiation successful
0806 02:20:12.606463 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":188,"threads_started":1}
I20260806 02:20:12.606684 14995 tablet_bootstrap.cc:654] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:12.606957 15529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.600264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51928 (local address 127.26.189.130:43383)
0806 02:20:12.600637 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:12.600650 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:12.600682 (+ 32us) server_negotiation.cc:407] Connection header received
0806 02:20:12.600751 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:12.600778 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:12.601036 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:12.601238 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:12.601495 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.603006 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.604661 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.605567 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.606503 (+ 936us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.606642 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:12.606699 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 02:20:12.606814 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":169,"threads_started":1}
I20260806 02:20:12.608184 14995 tablet_bootstrap.cc:492] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: No bootstrap required, opened a new log
I20260806 02:20:12.608296 14995 ts_tablet_manager.cc:1397] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260806 02:20:12.608770 14995 raft_consensus.cc:348] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:12.608903 14995 raft_consensus.cc:374] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:12.608942 14995 raft_consensus.cc:729] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d526359ccd43f182b33b4c92fb94a4, State: Initialized, Role: FOLLOWER
I20260806 02:20:12.609081 14995 consensus_queue.cc:260] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:12.609365 14995 ts_tablet_manager.cc:1428] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260806 02:20:12.610039 15431 tablet_service.cc:1467] Processing CreateTablet for tablet 394b7bc14f314dd683d4c31bee7c40ea (DEFAULT_TABLE table=test-table [id=08d9b1b58e274f8e9e26fb5e424596f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:12.610175 15240 tablet_service.cc:1467] Processing CreateTablet for tablet 394b7bc14f314dd683d4c31bee7c40ea (DEFAULT_TABLE table=test-table [id=08d9b1b58e274f8e9e26fb5e424596f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:12.611104 15431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394b7bc14f314dd683d4c31bee7c40ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:12.611202 15240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394b7bc14f314dd683d4c31bee7c40ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:12.618294 15533 tablet_bootstrap.cc:492] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930: Bootstrap starting.
I20260806 02:20:12.618289 15534 tablet_bootstrap.cc:492] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7: Bootstrap starting.
I20260806 02:20:12.621078 15534 tablet_bootstrap.cc:654] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:12.621109 15533 tablet_bootstrap.cc:654] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:12.621953 15534 log.cc:824] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:12.621951 15533 log.cc:824] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:12.623813 15533 tablet_bootstrap.cc:492] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930: No bootstrap required, opened a new log
I20260806 02:20:12.623816 15534 tablet_bootstrap.cc:492] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7: No bootstrap required, opened a new log
I20260806 02:20:12.624034 15533 ts_tablet_manager.cc:1397] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 02:20:12.624034 15534 ts_tablet_manager.cc:1397] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 02:20:12.627280 15533 raft_consensus.cc:348] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:12.627315 15534 raft_consensus.cc:348] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:12.627563 15533 raft_consensus.cc:374] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:12.627588 15534 raft_consensus.cc:374] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:12.627641 15534 raft_consensus.cc:729] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc002f339d1483485751dec13a5acc7, State: Initialized, Role: FOLLOWER
I20260806 02:20:12.627652 15533 raft_consensus.cc:729] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e8a90d6d7a643d6b8ebe0b9becbb930, State: Initialized, Role: FOLLOWER
I20260806 02:20:12.628099 15533 consensus_queue.cc:260] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:12.628099 15534 consensus_queue.cc:260] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:12.628873 15518 heartbeater.cc:503] Master 127.26.189.190:39557 was elected leader, sending a full tablet report...
I20260806 02:20:12.629156 15534 ts_tablet_manager.cc:1428] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 02:20:12.629163 15533 ts_tablet_manager.cc:1428] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 02:20:12.629498 15335 heartbeater.cc:503] Master 127.26.189.190:39557 was elected leader, sending a full tablet report...
I20260806 02:20:12.671245 15538 raft_consensus.cc:482] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:12.671463 15538 raft_consensus.cc:504] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
W20260806 02:20:12.671749 15145 tablet.cc:2369] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:20:12.672856 15538 leader_election.cc:288] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305), c0d526359ccd43f182b33b4c92fb94a4 (127.26.189.129:44879)
I20260806 02:20:12.676965 15337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.673216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:44305 (local address 127.26.189.130:40123)
0806 02:20:12.673375 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:12.673393 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:12.673529 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:12.674043 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:12.674046 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:12.674064 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:12.674246 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.674252 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.675016 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.675022 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.675835 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.675844 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.676500 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.676504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.676613 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.676660 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 02:20:12.676740 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 02:20:12.676812 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"spinlock_wait_cycles":29056}
I20260806 02:20:12.677001 15531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.673335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:40123 (local address 127.26.189.131:44305)
0806 02:20:12.673508 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:12.673514 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:12.673557 (+ 43us) server_negotiation.cc:407] Connection header received
0806 02:20:12.673851 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:12.673858 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:12.673917 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:12.674017 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:12.674373 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.674898 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.675968 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.676378 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.676509 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.676566 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:12.676799 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 02:20:12.676881 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 02:20:12.677557 15540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.673573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:44879 (local address 127.26.189.130:58019)
0806 02:20:12.673971 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:12.673982 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:12.674113 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:12.674429 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:12.674432 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:12.674450 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:12.674573 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.674582 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.675337 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.675342 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.676107 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:12.676116 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.676965 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.676968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:12.677235 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.677264 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 02:20:12.677346 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 02:20:12.677409 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":147,"threads_started":1}
I20260806 02:20:12.677613 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.673720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:58019 (local address 127.26.189.129:44879)
0806 02:20:12.673885 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:12.673890 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:12.674065 (+ 175us) server_negotiation.cc:407] Connection header received
0806 02:20:12.674243 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:12.674246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:12.674307 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:12.674417 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:12.674702 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.675210 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.676253 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.676734 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.676859 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.677008 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:12.677384 (+ 376us) server_negotiation.cc:299] Negotiation successful
0806 02:20:12.677463 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 02:20:12.677872 15458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "394b7bc14f314dd683d4c31bee7c40ea" candidate_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc002f339d1483485751dec13a5acc7" is_pre_election: true
I20260806 02:20:12.678221 15458 raft_consensus.cc:2454] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e8a90d6d7a643d6b8ebe0b9becbb930 in term 0.
I20260806 02:20:12.678362 15087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "394b7bc14f314dd683d4c31bee7c40ea" candidate_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d526359ccd43f182b33b4c92fb94a4" is_pre_election: true
I20260806 02:20:12.678673 15087 raft_consensus.cc:2454] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e8a90d6d7a643d6b8ebe0b9becbb930 in term 0.
I20260806 02:20:12.678790 15182 leader_election.cc:302] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc002f339d1483485751dec13a5acc7, 5e8a90d6d7a643d6b8ebe0b9becbb930; no voters:
I20260806 02:20:12.679085 15538 raft_consensus.cc:2781] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:20:12.679181 15538 raft_consensus.cc:482] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:20:12.679244 15538 raft_consensus.cc:3037] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:12.680703 15538 raft_consensus.cc:504] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:12.681134 15538 leader_election.cc:288] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [CANDIDATE]: Term 1 election: Requested vote from peers 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305), c0d526359ccd43f182b33b4c92fb94a4 (127.26.189.129:44879)
I20260806 02:20:12.681514 15458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "394b7bc14f314dd683d4c31bee7c40ea" candidate_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc002f339d1483485751dec13a5acc7"
I20260806 02:20:12.681679 15087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "394b7bc14f314dd683d4c31bee7c40ea" candidate_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d526359ccd43f182b33b4c92fb94a4"
I20260806 02:20:12.681692 15458 raft_consensus.cc:3037] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:12.681831 15087 raft_consensus.cc:3037] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:12.683022 15458 raft_consensus.cc:2454] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e8a90d6d7a643d6b8ebe0b9becbb930 in term 1.
I20260806 02:20:12.683105 15087 raft_consensus.cc:2454] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e8a90d6d7a643d6b8ebe0b9becbb930 in term 1.
I20260806 02:20:12.683352 15182 leader_election.cc:302] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc002f339d1483485751dec13a5acc7, 5e8a90d6d7a643d6b8ebe0b9becbb930; no voters:
I20260806 02:20:12.683526 15538 raft_consensus.cc:2781] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:20:12.683837 15538 raft_consensus.cc:686] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 1 LEADER]: Becoming Leader. State: Replica: 5e8a90d6d7a643d6b8ebe0b9becbb930, State: Running, Role: LEADER
I20260806 02:20:12.684198 15538 consensus_queue.cc:237] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:12.687568 14879 catalog_manager.cc:5495] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130). New cstate: current_term: 1 leader_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } health_report { overall_health: UNKNOWN } } }
I20260806 02:20:12.709497 15529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.705926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51940 (local address 127.26.189.130:43383)
0806 02:20:12.706061 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:12.706064 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:12.706077 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:20:12.706162 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:12.706164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:12.706222 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:12.706322 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:20:12.706537 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.707042 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.707859 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:12.708076 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:12.708162 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:12.708485 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:20:12.708933 (+ 448us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:20:12.709061 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:12.709278 (+ 217us) server_negotiation.cc:299] Negotiation successful
0806 02:20:12.709335 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 02:20:12.715734 15087 raft_consensus.cc:1261] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Refusing update from remote peer 5e8a90d6d7a643d6b8ebe0b9becbb930: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:20:12.715782 15458 raft_consensus.cc:1261] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7 [term 1 FOLLOWER]: Refusing update from remote peer 5e8a90d6d7a643d6b8ebe0b9becbb930: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:20:12.716444 15538 consensus_queue.cc:1035] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:20:12.716638 15541 consensus_queue.cc:1035] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:20:12.722754 15545 mvcc.cc:205] Tried to move back new op lower bound from 7315385600876113920 to 7315385600757325824. Current Snapshot: MvccSnapshot[applied={T|T < 7315385600876113920}]
I20260806 02:20:12.724949 15546 mvcc.cc:205] Tried to move back new op lower bound from 7315385600876113920 to 7315385600757325824. Current Snapshot: MvccSnapshot[applied={T|T < 7315385600876113920}]
I20260806 02:20:12.732226 14879 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:60534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:20:12.732429 14879 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:60534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:20:12.734800 14879 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Sending DeleteTablet for 3 replicas of tablet 394b7bc14f314dd683d4c31bee7c40ea
I20260806 02:20:12.735556 15060 tablet_service.cc:1514] Processing DeleteTablet for tablet 394b7bc14f314dd683d4c31bee7c40ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:12 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:46376
I20260806 02:20:12.735522 15240 tablet_service.cc:1514] Processing DeleteTablet for tablet 394b7bc14f314dd683d4c31bee7c40ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:12 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:51928
I20260806 02:20:12.735994 15556 tablet_replica.cc:330] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: stopping tablet replica
I20260806 02:20:12.736057 15431 tablet_service.cc:1514] Processing DeleteTablet for tablet 394b7bc14f314dd683d4c31bee7c40ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:12 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:41042
I20260806 02:20:12.736111 15557 tablet_replica.cc:330] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930: stopping tablet replica
I20260806 02:20:12.736294 15556 raft_consensus.cc:2229] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:20:12.736443 15557 raft_consensus.cc:2229] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:20:12.736615 15556 raft_consensus.cc:2258] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:12.736860 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 14938
I20260806 02:20:12.737071 15557 raft_consensus.cc:2258] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:12.743436 15558 tablet_replica.cc:330] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7: stopping tablet replica
I20260806 02:20:12.743928 15558 raft_consensus.cc:2229] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:20:12.744391 15558 raft_consensus.cc:2258] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:12.744854 15557 ts_tablet_manager.cc:1905] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:20:12.746333 15558 ts_tablet_manager.cc:1905] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:20:12.748013 15557 ts_tablet_manager.cc:1918] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:20:12.748147 15557 log.cc:1196] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/394b7bc14f314dd683d4c31bee7c40ea
I20260806 02:20:12.748549 15557 ts_tablet_manager.cc:1939] T 394b7bc14f314dd683d4c31bee7c40ea P 5e8a90d6d7a643d6b8ebe0b9becbb930: Deleting consensus metadata
I20260806 02:20:12.749981 14863 catalog_manager.cc:4841] TS 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383): tablet 394b7bc14f314dd683d4c31bee7c40ea (table test-table [id=08d9b1b58e274f8e9e26fb5e424596f5]) successfully deleted
I20260806 02:20:12.750229 15558 ts_tablet_manager.cc:1918] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:20:12.750403 15558 log.cc:1196] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/394b7bc14f314dd683d4c31bee7c40ea
I20260806 02:20:12.750828 15558 ts_tablet_manager.cc:1939] T 394b7bc14f314dd683d4c31bee7c40ea P 2dc002f339d1483485751dec13a5acc7: Deleting consensus metadata
I20260806 02:20:12.752314 14861 catalog_manager.cc:4841] TS 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305): tablet 394b7bc14f314dd683d4c31bee7c40ea (table test-table [id=08d9b1b58e274f8e9e26fb5e424596f5]) successfully deleted
W20260806 02:20:12.752672 14861 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:44879 (error 108)
I20260806 02:20:12.753798 15530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:12.753452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:44879 (local address 127.0.0.1:46380)
0806 02:20:12.753612 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:12.753694 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:44879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 02:20:12.754040 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 15149
W20260806 02:20:12.754055 14861 catalog_manager.cc:4584] TS c0d526359ccd43f182b33b4c92fb94a4 (127.26.189.129:44879): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 394b7bc14f314dd683d4c31bee7c40ea: Network error: Client connection negotiation failed: client connection to 127.26.189.129:44879: connect: Connection refused (error 111)
I20260806 02:20:12.767876 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 15338
I20260806 02:20:12.779656 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 14837
I20260806 02:20:12.790072 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39557
--webserver_interface=127.26.189.190
--webserver_port=43441
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:39557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:12.908933 15560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:12.909226 15560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:12.909269 15560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:12.913353 15560 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:20:12.913420 15560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:12.913441 15560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:12.913458 15560 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:20:12.913473 15560 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:20:12.918901 15560 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:39557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=43441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:12.920092 15560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:12.921234 15560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:12.930526 15567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:12.930536 15566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:12.930548 15569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:12.930621 15560 server_base.cc:1034] running on GCE node
I20260806 02:20:12.931453 15560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:12.932690 15560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:12.933872 15560 hybrid_clock.cc:648] HybridClock initialized: now 1785982812933857 us; error 27 us; skew 500 ppm
Aug 06 02:20:12 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:12.947325 15560 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:20:12.948475 15560 webserver.cc:460] Webserver started at http://127.26.189.190:43441/ using document root <none> and password file <none>
I20260806 02:20:12.949177 15560 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:12.949288 15560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:12.953805 15560 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:12.956221 15577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:12.957669 15560 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:12.957824 15560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "2e17fa9520b340bb95215aa07afb72a6"
format_stamp: "Formatted at 2026-08-06 02:20:10 on dist-test-slave-gkw7"
server_key: "54ec62cd5b172f54a2debabfb7e431b8"
server_key_iv: "dd86cf09f6c92f88fb034dc2d9b447e3"
server_key_version: "encryptionkey@0"
I20260806 02:20:12.958487 15560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:12.974675 15560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:12.978003 15560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:12.978230 15560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:12.986173 15560 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:39557
I20260806 02:20:12.986487 15643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:39557 every 8 connection(s)
I20260806 02:20:12.987493 15560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:20:12.988260 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 15560
I20260806 02:20:12.988722 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:44879
--local_ip_for_outbound_sockets=127.26.189.129
--tserver_master_addrs=127.26.189.190:39557
--webserver_port=46055
--webserver_interface=127.26.189.129
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:20:12.992641 15645 sys_catalog.cc:263] Verifying existing consensus state
I20260806 02:20:12.994669 15645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Bootstrap starting.
I20260806 02:20:13.020466 15645 log.cc:824] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:13.037518 15645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 02:20:13.038106 15645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6: Bootstrap complete.
I20260806 02:20:13.044471 15645 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } }
I20260806 02:20:13.045074 15645 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e17fa9520b340bb95215aa07afb72a6, State: Initialized, Role: FOLLOWER
I20260806 02:20:13.045694 15645 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } }
I20260806 02:20:13.045850 15645 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:20:13.045920 15645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:20:13.046020 15645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 2 FOLLOWER]: Advancing to term 3
I20260806 02:20:13.048228 15645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } }
I20260806 02:20:13.048601 15645 leader_election.cc:302] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e17fa9520b340bb95215aa07afb72a6; no voters:
I20260806 02:20:13.048995 15645 leader_election.cc:288] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 02:20:13.049145 15650 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 02:20:13.049424 15650 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [term 3 LEADER]: Becoming Leader. State: Replica: 2e17fa9520b340bb95215aa07afb72a6, State: Running, Role: LEADER
I20260806 02:20:13.049829 15650 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } }
I20260806 02:20:13.050420 15645 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:20:13.050971 15650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e17fa9520b340bb95215aa07afb72a6. Latest consensus state: current_term: 3 leader_uuid: "2e17fa9520b340bb95215aa07afb72a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } } }
I20260806 02:20:13.051786 15650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:13.051658 15651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "2e17fa9520b340bb95215aa07afb72a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e17fa9520b340bb95215aa07afb72a6" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39557 } } }
I20260806 02:20:13.052582 15651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e17fa9520b340bb95215aa07afb72a6 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:13.052704 15662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:20:13.058694 15662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:20:13.059378 15662 catalog_manager.cc:1259] Loaded cluster ID: 7c1f2b1eebc747f799ac3f3b357ca94b
I20260806 02:20:13.059450 15662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 02:20:13.060570 15662 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f6128c2c9ad google::LogMessage::Fail() at ??:0
@ 0x7f6128c2f88a google::LogMessage::SendToLog() at ??:0
@ 0x7f6128c2c4de google::LogMessage::Flush() at ??:0
@ 0x7f6128c2da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f613356bfdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f613356cd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f6133569579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f61335ad640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f612ae7e3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f612ae7ec83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f612ae803f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f612ae6f512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f612c4b36db start_thread at ??:0
@ 0x7f612772a61f clone at ??:0
W20260806 02:20:13.150360 15648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:13.150975 15648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:13.151081 15648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:13.155368 15648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:13.155439 15648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:13.155611 15648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:20:13.161963 15648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:44879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=46055
--tserver_master_addrs=127.26.189.190:39557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:13.163128 15648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:13.164191 15648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:13.174199 15694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:13.174249 15696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:13.174191 15699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:13.174672 15648 server_base.cc:1034] running on GCE node
I20260806 02:20:13.175130 15648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:13.175921 15648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:13.177151 15648 hybrid_clock.cc:648] HybridClock initialized: now 1785982813177118 us; error 47 us; skew 500 ppm
Aug 06 02:20:13 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982813, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:13.180819 15648 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:20:13.181807 15648 webserver.cc:460] Webserver started at http://127.26.189.129:46055/ using document root <none> and password file <none>
I20260806 02:20:13.182391 15648 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:13.182489 15648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:13.186600 15648 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260806 02:20:13.188964 15709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:13.190394 15648 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:20:13.190541 15648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "c0d526359ccd43f182b33b4c92fb94a4"
format_stamp: "Formatted at 2026-08-06 02:20:10 on dist-test-slave-gkw7"
server_key: "bfa93e3ddaa260f21199e51f343627af"
server_key_iv: "96cabbbae4e0494c5ac560543971f41a"
server_key_version: "encryptionkey@0"
I20260806 02:20:13.191104 15648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:13.207290 15648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:13.211043 15648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:13.211263 15648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:13.212055 15648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:13.213462 15717 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 02:20:13.219646 15648 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 02:20:13.219739 15648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.000s
I20260806 02:20:13.219830 15648 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 02:20:13.221618 15648 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 02:20:13.221683 15648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260806 02:20:13.222025 15717 tablet_bootstrap.cc:492] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: Bootstrap starting.
I20260806 02:20:13.232818 15648 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:44879
I20260806 02:20:13.233044 15858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:44879 every 8 connection(s)
I20260806 02:20:13.233911 15648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:20:13.240401 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 15648
I20260806 02:20:13.240856 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:43383
--local_ip_for_outbound_sockets=127.26.189.130
--tserver_master_addrs=127.26.189.190:39557
--webserver_port=34371
--webserver_interface=127.26.189.130
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:20:13.246405 15717 log.cc:824] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:13.256803 15717 tablet_bootstrap.cc:492] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 02:20:13.257295 15717 tablet_bootstrap.cc:492] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: Bootstrap complete.
I20260806 02:20:13.258962 15717 ts_tablet_manager.cc:1397] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: Time spent bootstrapping tablet: real 0.037s user 0.031s sys 0.005s
I20260806 02:20:13.262429 15717 raft_consensus.cc:348] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:13.262988 15717 raft_consensus.cc:729] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d526359ccd43f182b33b4c92fb94a4, State: Initialized, Role: FOLLOWER
I20260806 02:20:13.263542 15717 consensus_queue.cc:260] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:13.264631 15717 ts_tablet_manager.cc:1428] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260806 02:20:13.342193 15864 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:20:13.235889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:40177)
0806 02:20:13.236378 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:13.236433 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:13.237274 (+ 841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:13.341147 (+103873us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":138,"threads_started":1}
W20260806 02:20:13.342844 15859 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:39557 (0 consecutive failures): Network error: Failed to ping master at 127.26.189.190:39557: Client connection negotiation failed: client connection to 127.26.189.190:39557: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 02:20:13.343662 15864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:13.343330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:42835)
0806 02:20:13.343492 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:13.343580 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 02:20:13.344431 15864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:13.344183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:56903)
0806 02:20:13.344308 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:13.344366 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 02:20:13.344616 15859 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 02:20:13.367228 15865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:13.367475 15865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:13.367519 15865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:13.371490 15865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:13.371543 15865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:13.371599 15865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:20:13.376720 15865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:43383
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=34371
--tserver_master_addrs=127.26.189.190:39557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:13.377789 15865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:13.378763 15865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:13.388494 15873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:13.388514 15881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:13.388556 15874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:13.388620 15865 server_base.cc:1034] running on GCE node
I20260806 02:20:13.389181 15865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:13.389901 15865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:13.391099 15865 hybrid_clock.cc:648] HybridClock initialized: now 1785982813391071 us; error 40 us; skew 500 ppm
Aug 06 02:20:13 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982813, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:13.394047 15865 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:20:13.394986 15865 webserver.cc:460] Webserver started at http://127.26.189.130:34371/ using document root <none> and password file <none>
I20260806 02:20:13.395648 15865 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:13.395741 15865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:13.399742 15865 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260806 02:20:13.402112 15889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:13.403409 15865 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:13.403543 15865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930"
format_stamp: "Formatted at 2026-08-06 02:20:11 on dist-test-slave-gkw7"
server_key: "e44a310ad7975dd9877ae3cf86d46d1a"
server_key_iv: "0c12db3a10b5e5c0d2f1d01d10d36c31"
server_key_version: "encryptionkey@0"
I20260806 02:20:13.404079 15865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:13.427721 15865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:13.431384 15865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:13.431614 15865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:13.432307 15865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:13.433200 15865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:13.433249 15865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:13.433322 15865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:13.433364 15865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:13.443020 15865 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:43383
I20260806 02:20:13.443051 16044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:43383 every 8 connection(s)
I20260806 02:20:13.444082 15865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:20:13.447938 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:13.446326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:42939)
0806 02:20:13.446783 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:13.447229 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":109,"threads_started":1}
W20260806 02:20:13.448467 16045 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:39557 (0 consecutive failures): Network error: Failed to ping master at 127.26.189.190:39557: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
I20260806 02:20:13.449038 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:13.448835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:52759)
0806 02:20:13.448937 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:13.448982 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260806 02:20:13.449712 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:13.449476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:52301)
0806 02:20:13.449620 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:13.449661 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 02:20:13.449893 16045 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 02:20:13.452028 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 15865
I20260806 02:20:13.452461 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:44305
--local_ip_for_outbound_sockets=127.26.189.131
--tserver_master_addrs=127.26.189.190:39557
--webserver_port=40555
--webserver_interface=127.26.189.131
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:13.566816 16048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:13.567126 16048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:13.567178 16048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:13.571240 16048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:13.571290 16048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:13.571345 16048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:20:13.576474 16048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:44305
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=40555
--tserver_master_addrs=127.26.189.190:39557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:13.577430 16048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:13.578480 16048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:13.588290 16055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:13.588351 16054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:13.588320 16057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:13.588507 16048 server_base.cc:1034] running on GCE node
I20260806 02:20:13.588990 16048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:13.589664 16048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:13.590837 16048 hybrid_clock.cc:648] HybridClock initialized: now 1785982813590808 us; error 41 us; skew 500 ppm
Aug 06 02:20:13 dist-test-slave-gkw7 krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982813, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:13.593861 16048 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:20:13.594798 16048 webserver.cc:460] Webserver started at http://127.26.189.131:40555/ using document root <none> and password file <none>
I20260806 02:20:13.595389 16048 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:13.595454 16048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:13.599288 16048 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 02:20:13.601351 16064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:13.602749 16048 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:20:13.602890 16048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "2dc002f339d1483485751dec13a5acc7"
format_stamp: "Formatted at 2026-08-06 02:20:11 on dist-test-slave-gkw7"
server_key: "350aa10103ee0c462a73c3ef7423b504"
server_key_iv: "860efdb6694df2630ba3546b98d0ebec"
server_key_version: "encryptionkey@0"
I20260806 02:20:13.603425 16048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:13.626504 16048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:13.629786 16048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:13.629995 16048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:13.630615 16048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:13.631472 16048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:13.631544 16048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:13.631619 16048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:13.631661 16048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:13.641124 16048 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:44305
I20260806 02:20:13.641150 16221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:44305 every 8 connection(s)
I20260806 02:20:13.642190 16048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:20:13.646063 16224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:13.644336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:47767)
0806 02:20:13.644808 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:13.645262 (+ 454us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":111,"threads_started":1}
W20260806 02:20:13.646512 16222 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:39557 (0 consecutive failures): Network error: Failed to ping master at 127.26.189.190:39557: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
I20260806 02:20:13.647171 16224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:13.646949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:33879)
0806 02:20:13.647060 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:13.647109 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 02:20:13.647791 16224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:13.647590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:32867)
0806 02:20:13.647689 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:13.647736 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 02:20:13.647990 16222 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 02:20:13.649919 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 16048
I20260806 02:20:14.345796 16227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:14.345244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:40491)
0806 02:20:14.345600 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:14.345678 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":84,"threads_started":1}
I20260806 02:20:14.450981 16228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:14.450522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:47805)
0806 02:20:14.450819 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:14.450878 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":89,"threads_started":1}
I20260806 02:20:14.473330 16229 raft_consensus.cc:482] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:14.473642 16229 raft_consensus.cc:504] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:14.474741 16229 leader_election.cc:288] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383), 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305)
Aug 06 02:20:14 dist-test-slave-gkw7 krb5kdc[14089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982813, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.130@KRBTEST.COM
Aug 06 02:20:14 dist-test-slave-gkw7 krb5kdc[14089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982813, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.131@KRBTEST.COM
I20260806 02:20:14.496896 16227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:14.475022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:44305 (local address 127.26.189.129:51281)
0806 02:20:14.475167 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:14.475184 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:14.475304 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:14.477434 (+ 2130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:14.477438 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:14.478046 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:14.478923 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:14.478944 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:14.480940 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:14.480944 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:14.482541 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:14.482552 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:14.483844 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:14.483849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:14.483940 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:14.489151 (+ 5211us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:14.489194 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:14.491675 (+ 2481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:14.494339 (+ 2664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:14.494342 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:14.494345 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:14.494602 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:14.494967 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:14.494970 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:14.494973 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:14.495058 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:14.495847 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:14.495850 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:14.496024 (+ 174us) client_negotiation.cc:769] Sending connection context
0806 02:20:14.496262 (+ 238us) client_negotiation.cc:240] Negotiation successful
0806 02:20:14.496709 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":419,"spinlock_wait_cycles":49280}
I20260806 02:20:14.496928 16233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:14.475366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:51281 (local address 127.26.189.131:44305)
0806 02:20:14.475693 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:14.475705 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:14.475736 (+ 31us) server_negotiation.cc:407] Connection header received
0806 02:20:14.476543 (+ 807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:14.476552 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:14.477025 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:14.477375 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:14.479143 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:14.480754 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:14.482684 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:14.483432 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:14.483621 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:14.491914 (+ 8293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:14.491920 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:14.491930 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:14.491960 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:14.494051 (+ 2091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:14.494717 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:14.494721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:14.494725 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:14.494869 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:14.495178 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:14.495181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:14.495183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:14.495741 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:14.495847 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:14.496423 (+ 576us) server_negotiation.cc:299] Negotiation successful
0806 02:20:14.496729 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":100,"threads_started":1}
I20260806 02:20:14.496928 16230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:14.475175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:49315 (local address 127.26.189.130:43383)
0806 02:20:14.475545 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:14.475575 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:14.475626 (+ 51us) server_negotiation.cc:407] Connection header received
0806 02:20:14.476572 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:14.476579 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:14.477025 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:14.477375 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:14.479143 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:14.480754 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:14.482684 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:14.483432 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:14.483608 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:14.491618 (+ 8010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:14.491628 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:14.491646 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:14.491685 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:14.493521 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:14.494314 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:14.494323 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:14.494329 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:14.494517 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:14.494930 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:14.494935 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:14.494940 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:14.495554 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:14.495703 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:14.496423 (+ 720us) server_negotiation.cc:299] Negotiation successful
0806 02:20:14.496738 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":77,"threads_started":1}
I20260806 02:20:14.496896 16231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:14.475022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:43383 (local address 127.26.189.129:49315)
0806 02:20:14.475509 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:14.475523 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:14.475601 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:14.477642 (+ 2041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:14.477645 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:14.478057 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:14.478923 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:14.478944 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:14.480940 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:14.480944 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:14.482540 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:14.482552 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:14.483571 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:14.483575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:14.483764 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:14.489151 (+ 5387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:14.489179 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:14.491292 (+ 2113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:14.493710 (+ 2418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:14.493717 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:14.493732 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:14.494082 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:14.494634 (+ 552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:14.494637 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:14.494639 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:14.494829 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:14.495669 (+ 840us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:14.495675 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:14.496024 (+ 349us) client_negotiation.cc:769] Sending connection context
0806 02:20:14.496244 (+ 220us) client_negotiation.cc:240] Negotiation successful
0806 02:20:14.496656 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":407,"spinlock_wait_cycles":34688,"thread_start_us":74,"threads_started":1}
W20260806 02:20:14.499660 15713 leader_election.cc:341] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383): Not found: Tablet not found: 394b7bc14f314dd683d4c31bee7c40ea
W20260806 02:20:14.499830 15712 leader_election.cc:341] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305): Not found: Tablet not found: 394b7bc14f314dd683d4c31bee7c40ea
I20260806 02:20:14.499938 15712 leader_election.cc:302] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0d526359ccd43f182b33b4c92fb94a4; no voters: 2dc002f339d1483485751dec13a5acc7, 5e8a90d6d7a643d6b8ebe0b9becbb930
I20260806 02:20:14.500231 16229 raft_consensus.cc:2726] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:20:14.649049 16234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:14.648592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:40935)
0806 02:20:14.648898 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:14.648954 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":120,"threads_started":1}
I20260806 02:20:15.347079 16235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:15.346626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:59565)
0806 02:20:15.346917 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:15.346978 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":79,"threads_started":1}
I20260806 02:20:15.452279 16237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:15.451864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:47057)
0806 02:20:15.452138 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:15.452192 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":80,"threads_started":1}
I20260806 02:20:15.650317 16238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:15.649846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:44535)
0806 02:20:15.650128 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:15.650192 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":73,"threads_started":1}
I20260806 02:20:16.076455 16239 raft_consensus.cc:482] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:16.076668 16239 raft_consensus.cc:504] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:16.077189 16239 leader_election.cc:288] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383), 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305)
W20260806 02:20:16.078150 15712 leader_election.cc:341] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305): Not found: Tablet not found: 394b7bc14f314dd683d4c31bee7c40ea
W20260806 02:20:16.078243 15713 leader_election.cc:341] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383): Not found: Tablet not found: 394b7bc14f314dd683d4c31bee7c40ea
I20260806 02:20:16.078372 15713 leader_election.cc:302] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0d526359ccd43f182b33b4c92fb94a4; no voters: 2dc002f339d1483485751dec13a5acc7, 5e8a90d6d7a643d6b8ebe0b9becbb930
I20260806 02:20:16.078534 16239 raft_consensus.cc:2726] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:20:16.348428 16240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:16.347943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:58211)
0806 02:20:16.348250 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:16.348324 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":102,"threads_started":1}
I20260806 02:20:16.453593 16241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:16.453115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:40923)
0806 02:20:16.453387 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:16.453445 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":73,"threads_started":1}
I20260806 02:20:16.651536 16242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:16.651116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:41365)
0806 02:20:16.651383 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:16.651442 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":78,"threads_started":1}
I20260806 02:20:17.349741 16243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:17.349247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:58523)
0806 02:20:17.349570 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:17.349638 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":127,"threads_started":1}
I20260806 02:20:17.454735 16244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:17.454292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:33283)
0806 02:20:17.454590 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:17.454645 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":99,"threads_started":1}
I20260806 02:20:17.652746 16245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:17.652343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:51317)
0806 02:20:17.652585 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:17.652642 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":77,"threads_started":1}
I20260806 02:20:18.351218 16246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:18.350737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:33405)
0806 02:20:18.351058 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:18.351120 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":75,"threads_started":1}
I20260806 02:20:18.455998 16247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:18.455595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:41067)
0806 02:20:18.455845 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:18.455902 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":78,"threads_started":1}
I20260806 02:20:18.654007 16251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:18.653574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:42471)
0806 02:20:18.653849 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:18.653910 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":76,"threads_started":1}
I20260806 02:20:19.016240 16253 raft_consensus.cc:482] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:19.016390 16253 raft_consensus.cc:504] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:19.016837 16253 leader_election.cc:288] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383), 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305)
W20260806 02:20:19.017771 15712 leader_election.cc:341] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305): Not found: Tablet not found: 394b7bc14f314dd683d4c31bee7c40ea
W20260806 02:20:19.017887 15713 leader_election.cc:341] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383): Not found: Tablet not found: 394b7bc14f314dd683d4c31bee7c40ea
I20260806 02:20:19.017956 15713 leader_election.cc:302] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0d526359ccd43f182b33b4c92fb94a4; no voters: 2dc002f339d1483485751dec13a5acc7, 5e8a90d6d7a643d6b8ebe0b9becbb930
I20260806 02:20:19.018103 16253 raft_consensus.cc:2726] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:20:19.352690 16254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:19.352244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:40961)
0806 02:20:19.352534 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:19.352588 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":106,"threads_started":1}
I20260806 02:20:19.457311 16255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:19.456775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:55193)
0806 02:20:19.457136 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:19.457194 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":73,"threads_started":1}
I20260806 02:20:19.655269 16256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:19.654778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:56699)
0806 02:20:19.655098 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:19.655168 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":79,"threads_started":1}
I20260806 02:20:20.354043 16257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:20.353615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:52709)
0806 02:20:20.353888 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:20.353945 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":83,"threads_started":1}
I20260806 02:20:20.458618 16258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:20.458162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:50251)
0806 02:20:20.458462 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:20.458523 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":73,"threads_started":1}
I20260806 02:20:20.656764 16259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:20.656201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:36085)
0806 02:20:20.656574 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:20.656660 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":79,"threads_started":1}
I20260806 02:20:21.355358 16261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:21.354887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:38137)
0806 02:20:21.355174 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:21.355256 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":78,"threads_started":1}
I20260806 02:20:21.459796 16263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:21.459326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:33595)
0806 02:20:21.459630 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:21.459698 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":79,"threads_started":1}
I20260806 02:20:21.469379 16264 raft_consensus.cc:482] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:21.469570 16264 raft_consensus.cc:504] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:21.470042 16264 leader_election.cc:288] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383), 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305)
W20260806 02:20:21.470876 15713 leader_election.cc:341] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383): Not found: Tablet not found: 394b7bc14f314dd683d4c31bee7c40ea
W20260806 02:20:21.471011 15712 leader_election.cc:341] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305): Not found: Tablet not found: 394b7bc14f314dd683d4c31bee7c40ea
I20260806 02:20:21.471159 15712 leader_election.cc:302] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0d526359ccd43f182b33b4c92fb94a4; no voters: 2dc002f339d1483485751dec13a5acc7, 5e8a90d6d7a643d6b8ebe0b9becbb930
I20260806 02:20:21.471334 16264 raft_consensus.cc:2726] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:20:21.658052 16265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:21.657648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:36247)
0806 02:20:21.657895 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:21.657952 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":77,"threads_started":1}
I20260806 02:20:22.356779 16266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:22.356292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:33071)
0806 02:20:22.356600 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:22.356664 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":106,"threads_started":1}
I20260806 02:20:22.461143 16267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:22.460632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:52061)
0806 02:20:22.460930 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:22.460991 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":89,"threads_started":1}
I20260806 02:20:22.659435 16268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:22.658906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:59125)
0806 02:20:22.659203 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:22.659313 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":109,"threads_started":1}
I20260806 02:20:23.358318 16269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:23.357864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:51527)
0806 02:20:23.358145 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:23.358208 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":85,"threads_started":1}
I20260806 02:20:23.462617 16270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:23.462160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:48215)
0806 02:20:23.462448 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:23.462515 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":99,"threads_started":1}
I20260806 02:20:23.660874 16271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:23.660388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:38603)
0806 02:20:23.660700 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:23.660772 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":105,"threads_started":1}
I20260806 02:20:24.059717 16272 raft_consensus.cc:482] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:24.059974 16272 raft_consensus.cc:504] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:24.060535 16272 leader_election.cc:288] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383), 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305)
W20260806 02:20:24.061383 15713 leader_election.cc:341] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383): Not found: Tablet not found: 394b7bc14f314dd683d4c31bee7c40ea
W20260806 02:20:24.061501 15712 leader_election.cc:341] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305): Not found: Tablet not found: 394b7bc14f314dd683d4c31bee7c40ea
I20260806 02:20:24.061645 15712 leader_election.cc:302] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0d526359ccd43f182b33b4c92fb94a4; no voters: 2dc002f339d1483485751dec13a5acc7, 5e8a90d6d7a643d6b8ebe0b9becbb930
I20260806 02:20:24.061822 16272 raft_consensus.cc:2726] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:20:24.359741 16274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:24.359225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:34575)
0806 02:20:24.359565 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:24.359634 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":106,"threads_started":1}
I20260806 02:20:24.464089 16275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:24.463587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:44955)
0806 02:20:24.463929 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:24.463990 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":106,"threads_started":1}
I20260806 02:20:24.662302 16277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:24.661808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:45685)
0806 02:20:24.662132 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:24.662198 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":80,"threads_started":1}
I20260806 02:20:25.361274 16280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:25.360718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:50965)
0806 02:20:25.361093 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:25.361160 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":167,"threads_started":1}
I20260806 02:20:25.465378 16282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:25.464924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:59555)
0806 02:20:25.465191 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:25.465274 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":81,"threads_started":1}
I20260806 02:20:25.663635 16283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:25.663159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:54277)
0806 02:20:25.663470 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:25.663534 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":87,"threads_started":1}
I20260806 02:20:26.362499 16284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:26.362037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:55685)
0806 02:20:26.362338 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:26.362396 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":99,"threads_started":1}
I20260806 02:20:26.466799 16286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:26.466287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:59643)
0806 02:20:26.466634 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:26.466701 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":106,"threads_started":1}
I20260806 02:20:26.665086 16287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:26.664609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:57515)
0806 02:20:26.664916 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:26.664981 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":87,"threads_started":1}
I20260806 02:20:27.363811 16288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:27.363345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:37341)
0806 02:20:27.363626 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:27.363688 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":83,"threads_started":1}
I20260806 02:20:27.468263 16290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:27.467703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:52089)
0806 02:20:27.468059 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:27.468134 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":100,"threads_started":1}
I20260806 02:20:27.537290 16291 raft_consensus.cc:482] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:27.537437 16291 raft_consensus.cc:504] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e8a90d6d7a643d6b8ebe0b9becbb930" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 43383 } } peers { permanent_uuid: "2dc002f339d1483485751dec13a5acc7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44305 } } peers { permanent_uuid: "c0d526359ccd43f182b33b4c92fb94a4" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 44879 } }
I20260806 02:20:27.537917 16291 leader_election.cc:288] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383), 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305)
W20260806 02:20:27.538947 15713 leader_election.cc:341] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5e8a90d6d7a643d6b8ebe0b9becbb930 (127.26.189.130:43383): Not found: Tablet not found: 394b7bc14f314dd683d4c31bee7c40ea
W20260806 02:20:27.539055 15712 leader_election.cc:341] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2dc002f339d1483485751dec13a5acc7 (127.26.189.131:44305): Not found: Tablet not found: 394b7bc14f314dd683d4c31bee7c40ea
I20260806 02:20:27.539182 15712 leader_election.cc:302] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0d526359ccd43f182b33b4c92fb94a4; no voters: 2dc002f339d1483485751dec13a5acc7, 5e8a90d6d7a643d6b8ebe0b9becbb930
I20260806 02:20:27.539486 16291 raft_consensus.cc:2726] T 394b7bc14f314dd683d4c31bee7c40ea P c0d526359ccd43f182b33b4c92fb94a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:20:27.666566 16292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:27.666098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:51703)
0806 02:20:27.666397 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:27.666463 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":87,"threads_started":1}
I20260806 02:20:28.365361 16293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:28.364890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.129:53895)
0806 02:20:28.365186 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:28.365255 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":80,"threads_started":1}
I20260806 02:20:28.469838 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:28.469301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.130:42075)
0806 02:20:28.469675 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:28.469736 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":97,"threads_started":1}
I20260806 02:20:28.655396 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 15648
I20260806 02:20:28.668280 16296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:28.667737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:39557 (local address 127.26.189.131:37285)
0806 02:20:28.668105 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:28.668178 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":113,"threads_started":1}
I20260806 02:20:28.669350 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 15865
I20260806 02:20:28.681258 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 16048
2026-08-06T02:20:28Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19670 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:20:28 dist-test-slave-gkw7 krb5kdc[16300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:20:28 dist-test-slave-gkw7 krb5kdc[16300](info): set up 2 sockets
Aug 06 02:20:28 dist-test-slave-gkw7 krb5kdc[16300](info): commencing operation
krb5kdc: starting...
W20260806 02:20:30.007522 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:20:30 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:20:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:20:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:20:30.144938 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:36853
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:36853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:30.263777 16318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:30.264065 16318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:30.264106 16318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:30.268208 16318 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 02:20:30.268277 16318 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 02:20:30.268293 16318 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 02:20:30.268309 16318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:20:30.268328 16318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:30.268388 16318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:30.268424 16318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:20:30.268445 16318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:20:30.274132 16318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:36853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:36853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:30.275367 16318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:30.276512 16318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 02:20:30.286120 16318 server_base.cc:1034] running on GCE node
W20260806 02:20:30.286221 16329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:30.286226 16331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:30.286126 16326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:30.287145 16318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:30.288273 16318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:30.289439 16318 hybrid_clock.cc:648] HybridClock initialized: now 1785982830289420 us; error 34 us; skew 500 ppm
Aug 06 02:20:30 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982830, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:30.292423 16318 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:20:30.293370 16318 webserver.cc:460] Webserver started at http://127.26.189.190:43915/ using document root <none> and password file <none>
I20260806 02:20:30.294008 16318 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:30.294075 16318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:30.294332 16318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:20:30.296495 16318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "4114891c70c24e0385d8d436ea5aded0"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "3b5c4eb086c399cd31776be7f90270ba"
server_key_iv: "e371964f5eb9ef2a0fca8e3fbed25680"
server_key_version: "encryptionkey@0"
I20260806 02:20:30.297123 16318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "4114891c70c24e0385d8d436ea5aded0"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "3b5c4eb086c399cd31776be7f90270ba"
server_key_iv: "e371964f5eb9ef2a0fca8e3fbed25680"
server_key_version: "encryptionkey@0"
I20260806 02:20:30.301141 16318 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:20:30.304029 16341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:30.305387 16318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:20:30.305538 16318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "4114891c70c24e0385d8d436ea5aded0"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "3b5c4eb086c399cd31776be7f90270ba"
server_key_iv: "e371964f5eb9ef2a0fca8e3fbed25680"
server_key_version: "encryptionkey@0"
I20260806 02:20:30.305688 16318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:30.330991 16318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:30.334555 16318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:30.334777 16318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:30.342141 16318 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:36853
I20260806 02:20:30.342443 16410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:36853 every 8 connection(s)
I20260806 02:20:30.343179 16318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:20:30.346181 16411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:30.351928 16411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Bootstrap starting.
I20260806 02:20:30.353346 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 16318
I20260806 02:20:30.353482 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:20:30.353854 27382 external_mini_cluster.cc:1428] Setting key 1176649aace9b3e71b5d41cdd3285a90
I20260806 02:20:30.355155 16411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:30.356007 16411 log.cc:824] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:30.358176 16411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: No bootstrap required, opened a new log
I20260806 02:20:30.361861 16411 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } }
I20260806 02:20:30.362118 16411 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:30.362201 16411 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4114891c70c24e0385d8d436ea5aded0, State: Initialized, Role: FOLLOWER
I20260806 02:20:30.362700 16411 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } }
I20260806 02:20:30.362859 16411 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:20:30.362950 16411 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:20:30.363052 16411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 0 FOLLOWER]: Advancing to term 1
Aug 06 02:20:30 dist-test-slave-gkw7 krb5kdc[16300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:30.364089 16411 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } }
I20260806 02:20:30.364446 16411 leader_election.cc:302] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4114891c70c24e0385d8d436ea5aded0; no voters:
I20260806 02:20:30.364840 16411 leader_election.cc:288] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:20:30.365026 16417 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:20:30.365224 16417 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 1 LEADER]: Becoming Leader. State: Replica: 4114891c70c24e0385d8d436ea5aded0, State: Running, Role: LEADER
I20260806 02:20:30.365932 16417 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } }
I20260806 02:20:30.366334 16411 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:20:30.367877 16419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4114891c70c24e0385d8d436ea5aded0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } } }
I20260806 02:20:30.368002 16419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:30.369164 16433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:20:30.368777 16418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4114891c70c24e0385d8d436ea5aded0. Latest consensus state: current_term: 1 leader_uuid: "4114891c70c24e0385d8d436ea5aded0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } } }
I20260806 02:20:30.369881 16418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:30.370903 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:30.355101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36736 (local address 127.26.189.190:36853)
0806 02:20:30.355593 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:30.355616 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:30.355656 (+ 40us) server_negotiation.cc:407] Connection header received
0806 02:20:30.356472 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:30.356499 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:30.356964 (+ 465us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:30.357356 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:30.358316 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:30.359420 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:30.360395 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:30.360904 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:30.361110 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:30.364172 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:30.364178 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:30.364193 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:30.364248 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:30.366535 (+ 2287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:30.367017 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:30.367023 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:30.367029 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:30.367205 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:30.367548 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:30.367553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:30.367556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:30.368190 (+ 634us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:30.369490 (+ 1300us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:30.369720 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 02:20:30.370128 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":157,"threads_started":1}
I20260806 02:20:30.372685 16433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:20:30.378636 16433 catalog_manager.cc:1347] Generated new cluster ID: 876f9bd5b44048d4a0f678d7565b2403
I20260806 02:20:30.378721 16433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:20:30.384150 16433 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:20:30.385185 16433 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:20:30.389379 16433 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Generated new TSK 0
I20260806 02:20:30.390201 16433 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:20:30.429096 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36853
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:30.549639 16444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:30.549952 16444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:30.549997 16444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:30.554158 16444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:30.554293 16444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:30.554414 16444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:20:30.560025 16444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:30.561105 16444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:30.562216 16444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:30.573086 16453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:30.573081 16452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:30.573081 16456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:30.573563 16444 server_base.cc:1034] running on GCE node
I20260806 02:20:30.574049 16444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:30.574739 16444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:30.575953 16444 hybrid_clock.cc:648] HybridClock initialized: now 1785982830575915 us; error 50 us; skew 500 ppm
Aug 06 02:20:30 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982830, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:30.578959 16444 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:20:30.579885 16444 webserver.cc:460] Webserver started at http://127.26.189.129:45255/ using document root <none> and password file <none>
I20260806 02:20:30.580485 16444 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:30.580581 16444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:30.580824 16444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:20:30.583078 16444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "7ca1a63f5be445bb82013fa3d1842e58"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "09157d8a6b08be6cb02f9d40c6a1b121"
server_key_iv: "2c3ab789b0726c54297b5d8a54ef389b"
server_key_version: "encryptionkey@0"
I20260806 02:20:30.583686 16444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "7ca1a63f5be445bb82013fa3d1842e58"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "09157d8a6b08be6cb02f9d40c6a1b121"
server_key_iv: "2c3ab789b0726c54297b5d8a54ef389b"
server_key_version: "encryptionkey@0"
I20260806 02:20:30.587726 16444 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:20:30.590363 16465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:30.591673 16444 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:30.591825 16444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "7ca1a63f5be445bb82013fa3d1842e58"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "09157d8a6b08be6cb02f9d40c6a1b121"
server_key_iv: "2c3ab789b0726c54297b5d8a54ef389b"
server_key_version: "encryptionkey@0"
I20260806 02:20:30.591948 16444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:30.618927 16444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:30.622345 16444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:30.622566 16444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:30.623216 16444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:30.624110 16444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:30.624209 16444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:30.624305 16444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:30.624357 16444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:30.633836 16444 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:38291
I20260806 02:20:30.633857 16624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:38291 every 8 connection(s)
I20260806 02:20:30.634779 16444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:20:30.637223 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 16444
I20260806 02:20:30.637362 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:20:30.637801 27382 external_mini_cluster.cc:1428] Setting key 233f57a0412294469a05b76aec8b9b0b
Aug 06 02:20:30 dist-test-slave-gkw7 krb5kdc[16300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982830, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
I20260806 02:20:30.650274 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:30.636746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:44699 (local address 127.26.189.190:36853)
0806 02:20:30.636902 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:30.636906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:30.638279 (+ 1373us) server_negotiation.cc:407] Connection header received
0806 02:20:30.639212 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:30.639215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:30.639270 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:30.639353 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:30.640562 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:30.641115 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:30.643023 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:30.643264 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:30.643354 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:30.646434 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:30.646438 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:30.646443 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:30.646474 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:30.647964 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:30.648532 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:30.648535 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:30.648537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:30.648663 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:30.649031 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:30.649034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:30.649036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:30.649234 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:30.649347 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:30.649947 (+ 600us) server_negotiation.cc:299] Negotiation successful
0806 02:20:30.650085 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 02:20:30.651109 16628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:30.637184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:44699)
0806 02:20:30.638085 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:30.638149 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:30.639006 (+ 857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:30.639530 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:30.639536 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:30.639903 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:30.640403 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:30.640418 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:30.641275 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:30.641282 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:30.642883 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:30.642899 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:30.643435 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:30.643442 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:30.643684 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:30.644369 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:30.644400 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:30.646253 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:30.648104 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:30.648111 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:30.648127 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:30.648409 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:30.648759 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:30.648763 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:30.648765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:30.648921 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:30.649347 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:30.649355 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:30.649691 (+ 336us) client_negotiation.cc:769] Sending connection context
0806 02:20:30.649887 (+ 196us) client_negotiation.cc:240] Negotiation successful
0806 02:20:30.650249 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":158,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:20:30.652542 16626 heartbeater.cc:347] Connected to a master server at 127.26.189.190:36853
I20260806 02:20:30.652817 16626 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:30.653339 16626 heartbeater.cc:511] Master 127.26.189.190:36853 requested a full tablet report, sending...
I20260806 02:20:30.654969 16364 ts_manager.cc:194] Registered new tserver with Master: 7ca1a63f5be445bb82013fa3d1842e58 (127.26.189.129:38291)
I20260806 02:20:30.656170 16364 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:44699
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:20:30.668995 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36853
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:30.786266 16631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:30.786522 16631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:30.786566 16631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:30.790486 16631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:30.790537 16631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:30.790593 16631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:20:30.795826 16631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:30.796905 16631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:30.797977 16631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:30.808051 16636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:30.808035 16638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:30.808110 16641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:30.808482 16631 server_base.cc:1034] running on GCE node
I20260806 02:20:30.809018 16631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:30.809794 16631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:30.810986 16631 hybrid_clock.cc:648] HybridClock initialized: now 1785982830810967 us; error 40 us; skew 500 ppm
Aug 06 02:20:30 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982830, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:30.813879 16631 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:20:30.814824 16631 webserver.cc:460] Webserver started at http://127.26.189.130:46803/ using document root <none> and password file <none>
I20260806 02:20:30.815423 16631 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:30.815522 16631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:30.815779 16631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:20:30.818001 16631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "5b9e564a3ad04418ad3686c04d53cb6c"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "5b2f2fca923e1bb2d200a61b89358bd7"
server_key_iv: "8ea243de0ce9af7bf9f5c6f43a839357"
server_key_version: "encryptionkey@0"
I20260806 02:20:30.818593 16631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "5b9e564a3ad04418ad3686c04d53cb6c"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "5b2f2fca923e1bb2d200a61b89358bd7"
server_key_iv: "8ea243de0ce9af7bf9f5c6f43a839357"
server_key_version: "encryptionkey@0"
I20260806 02:20:30.822508 16631 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 02:20:30.825055 16649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:30.826514 16631 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:30.826651 16631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "5b9e564a3ad04418ad3686c04d53cb6c"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "5b2f2fca923e1bb2d200a61b89358bd7"
server_key_iv: "8ea243de0ce9af7bf9f5c6f43a839357"
server_key_version: "encryptionkey@0"
I20260806 02:20:30.826779 16631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:30.839385 16631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:30.842592 16631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:30.842808 16631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:30.843421 16631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:30.844288 16631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:30.844362 16631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:30.844436 16631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:30.844491 16631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:30.854113 16631 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:45199
I20260806 02:20:30.854140 16796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:45199 every 8 connection(s)
I20260806 02:20:30.855036 16631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:20:30.856817 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 16631
I20260806 02:20:30.856952 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:20:30.857280 27382 external_mini_cluster.cc:1428] Setting key 710505e0b8143198f82a8c31a31fa1fd
Aug 06 02:20:30 dist-test-slave-gkw7 krb5kdc[16300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982830, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
I20260806 02:20:30.869418 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:30.857072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:55631 (local address 127.26.189.190:36853)
0806 02:20:30.857230 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:30.857237 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:30.858459 (+ 1222us) server_negotiation.cc:407] Connection header received
0806 02:20:30.859469 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:30.859472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:30.859523 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:30.859604 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:30.860758 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:30.861301 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:30.862557 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:30.862804 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:30.862919 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:30.865432 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:30.865441 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:30.865443 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:30.865466 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:30.867188 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:30.867769 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:30.867774 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:30.867776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:30.867880 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:30.868247 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:30.868251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:30.868253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:30.868453 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:30.868564 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:30.869108 (+ 544us) server_negotiation.cc:299] Negotiation successful
0806 02:20:30.869246 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 02:20:30.870419 16799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:30.857579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:55631)
0806 02:20:30.858312 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:30.858355 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:30.859267 (+ 912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:30.859774 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:30.859781 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:30.860140 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:30.860614 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:30.860627 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:30.861432 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:30.861435 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:30.862427 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:30.862437 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:30.862959 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:30.862964 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:30.863153 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:30.863772 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:30.863789 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:30.865266 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:30.867309 (+ 2043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:30.867315 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:30.867333 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:30.867657 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:30.867989 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:30.867992 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:30.867994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:30.868146 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:30.868565 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:30.868582 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:30.868854 (+ 272us) client_negotiation.cc:769] Sending connection context
0806 02:20:30.869055 (+ 201us) client_negotiation.cc:240] Negotiation successful
0806 02:20:30.869430 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":125,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
I20260806 02:20:30.871769 16797 heartbeater.cc:347] Connected to a master server at 127.26.189.190:36853
I20260806 02:20:30.872056 16797 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:30.872695 16797 heartbeater.cc:511] Master 127.26.189.190:36853 requested a full tablet report, sending...
I20260806 02:20:30.873976 16364 ts_manager.cc:194] Registered new tserver with Master: 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199)
I20260806 02:20:30.874600 16364 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:55631
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:20:30.889250 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36853
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:31.006244 16803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:31.006551 16803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:31.006623 16803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:31.010998 16803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:31.011088 16803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:31.011193 16803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:20:31.016754 16803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:36853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:31.018014 16803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:31.019117 16803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:31.029461 16808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:31.029474 16809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:31.029464 16811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:31.029781 16803 server_base.cc:1034] running on GCE node
I20260806 02:20:31.030493 16803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:31.031298 16803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:31.032488 16803 hybrid_clock.cc:648] HybridClock initialized: now 1785982831032450 us; error 34 us; skew 500 ppm
Aug 06 02:20:31 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982831, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:31.035480 16803 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:20:31.036440 16803 webserver.cc:460] Webserver started at http://127.26.189.131:43013/ using document root <none> and password file <none>
I20260806 02:20:31.037052 16803 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:31.037117 16803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:31.037346 16803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:20:31.039557 16803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "1b3e8c1e07784fcb9aa4a09f43d14784"
format_stamp: "Formatted at 2026-08-06 02:20:31 on dist-test-slave-gkw7"
server_key: "48620602c7d8a3933eff0cbdbd816205"
server_key_iv: "bf5096b5af48567ff7f0391224f5f967"
server_key_version: "encryptionkey@0"
I20260806 02:20:31.040153 16803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "1b3e8c1e07784fcb9aa4a09f43d14784"
format_stamp: "Formatted at 2026-08-06 02:20:31 on dist-test-slave-gkw7"
server_key: "48620602c7d8a3933eff0cbdbd816205"
server_key_iv: "bf5096b5af48567ff7f0391224f5f967"
server_key_version: "encryptionkey@0"
I20260806 02:20:31.044106 16803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 02:20:31.046908 16823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:31.048301 16803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 02:20:31.048430 16803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "1b3e8c1e07784fcb9aa4a09f43d14784"
format_stamp: "Formatted at 2026-08-06 02:20:31 on dist-test-slave-gkw7"
server_key: "48620602c7d8a3933eff0cbdbd816205"
server_key_iv: "bf5096b5af48567ff7f0391224f5f967"
server_key_version: "encryptionkey@0"
I20260806 02:20:31.048547 16803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:31.072633 16803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:31.076349 16803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:31.076606 16803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:31.077335 16803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:31.078330 16803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:31.078382 16803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:31.078454 16803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:31.078487 16803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:31.087927 16803 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:45173
I20260806 02:20:31.088028 16974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:45173 every 8 connection(s)
I20260806 02:20:31.088908 16803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:20:31.097456 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 16803
I20260806 02:20:31.097630 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:20:31.097957 27382 external_mini_cluster.cc:1428] Setting key 62482c28edf289b914d5269797ab482f
Aug 06 02:20:31 dist-test-slave-gkw7 krb5kdc[16300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982831, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:31.103626 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.090809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:43153 (local address 127.26.189.190:36853)
0806 02:20:31.090946 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:31.090950 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:31.091983 (+ 1033us) server_negotiation.cc:407] Connection header received
0806 02:20:31.092942 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:31.092945 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:31.093004 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:31.093119 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:31.094452 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.095059 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.096362 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.096591 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.096706 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.099735 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:31.099738 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:31.099741 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:31.099769 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:31.101371 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:31.101957 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:31.101964 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:31.101968 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:31.102072 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:31.102471 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:31.102477 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:31.102481 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:31.102745 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:31.102852 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:31.103351 (+ 499us) server_negotiation.cc:299] Negotiation successful
0806 02:20:31.103497 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 02:20:31.104530 16978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.091142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:43153)
0806 02:20:31.091823 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:31.091867 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:31.092730 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:31.093305 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:31.093312 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:31.093765 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:31.094270 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:31.094308 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.095212 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.095215 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:31.096227 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:31.096237 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.096753 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.096758 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:31.096927 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.097625 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:31.097641 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:31.099560 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:31.101483 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:31.101489 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:31.101503 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:31.101853 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:31.102210 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:31.102212 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:31.102213 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:31.102364 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:31.102851 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:31.102856 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:31.103102 (+ 246us) client_negotiation.cc:769] Sending connection context
0806 02:20:31.103263 (+ 161us) client_negotiation.cc:240] Negotiation successful
0806 02:20:31.103539 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":122,"threads_started":1}
I20260806 02:20:31.105876 16976 heartbeater.cc:347] Connected to a master server at 127.26.189.190:36853
I20260806 02:20:31.106153 16976 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:31.106690 16976 heartbeater.cc:511] Master 127.26.189.190:36853 requested a full tablet report, sending...
I20260806 02:20:31.107833 16364 ts_manager.cc:194] Registered new tserver with Master: 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173)
I20260806 02:20:31.108502 16364 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:43153
I20260806 02:20:31.112330 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:20:31.123044 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.114559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36750 (local address 127.26.189.190:36853)
0806 02:20:31.114779 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:31.114786 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:31.114963 (+ 177us) server_negotiation.cc:407] Connection header received
0806 02:20:31.115162 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:31.115166 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:31.115226 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:31.115332 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:31.116196 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.116810 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.117883 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.118149 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.118286 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.119778 (+ 1492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:31.119782 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:31.119785 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:31.119817 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:31.121169 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:31.121690 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:31.121694 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:31.121696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:31.121785 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:31.122089 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:31.122093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:31.122095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:31.122327 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:31.122473 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:31.122740 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 02:20:31.122872 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260806 02:20:31.126579 16364 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36750:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:20:31.129926 16364 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:20:31.145761 16995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.139935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:45173 (local address 127.0.0.1:57538)
0806 02:20:31.140723 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:31.140737 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:31.140828 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:31.141439 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:31.141441 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:31.141456 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:31.141522 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:31.141577 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.142929 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.142932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:31.143930 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:31.143940 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.145002 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.145005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:31.145119 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.145211 (+ 92us) client_negotiation.cc:769] Sending connection context
0806 02:20:31.145322 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 02:20:31.145479 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"mutex_wait_us":25,"thread_start_us":97,"threads_started":1}
I20260806 02:20:31.145856 16994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.139379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56526 (local address 127.26.189.130:45199)
0806 02:20:31.139752 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:31.139765 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:31.140268 (+ 503us) server_negotiation.cc:407] Connection header received
0806 02:20:31.140468 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:31.140473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:31.140641 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:31.140750 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:31.141295 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.142581 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.144259 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.145025 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.145180 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.145307 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:31.145412 (+ 105us) server_negotiation.cc:299] Negotiation successful
0806 02:20:31.145507 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":127,"threads_started":1}
I20260806 02:20:31.145893 16997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.140283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57538 (local address 127.26.189.131:45173)
0806 02:20:31.141046 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:31.141054 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:31.141070 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:20:31.141131 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:31.141134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:31.141303 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:31.141458 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:31.141665 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.142754 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.144062 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.144884 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.145015 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.145172 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:31.145588 (+ 416us) server_negotiation.cc:299] Negotiation successful
0806 02:20:31.145737 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":678,"thread_start_us":151,"threads_started":1}
I20260806 02:20:31.147017 16990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.139129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38291 (local address 127.0.0.1:45244)
0806 02:20:31.139883 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:31.139936 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:31.140077 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:31.140909 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:31.140916 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:31.140943 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:31.141163 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:31.141169 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.142574 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.142579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:31.144132 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:31.144138 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.146633 (+ 2495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.146638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:31.146759 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.146783 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 02:20:31.146858 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 02:20:31.146912 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"mutex_wait_us":141,"spinlock_wait_cycles":1920,"thread_start_us":93,"threads_started":1}
I20260806 02:20:31.147166 16991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.139252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45244 (local address 127.26.189.129:38291)
0806 02:20:31.139958 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:31.139980 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:31.140012 (+ 32us) server_negotiation.cc:407] Connection header received
0806 02:20:31.140302 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:31.140309 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:31.140524 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:31.140690 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:31.141653 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.142431 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.145252 (+ 2821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.146505 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.146616 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.146702 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:31.146918 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 02:20:31.147016 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":88,"threads_started":1}
I20260806 02:20:31.148764 16884 tablet_service.cc:1467] Processing CreateTablet for tablet 78e068c68c67443e895636395a930740 (DEFAULT_TABLE table=test-table [id=a8e0eb32a476487d9547eded3d4b78f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:31.149919 16884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78e068c68c67443e895636395a930740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:31.150177 16992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.139129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:45199 (local address 127.0.0.1:56526)
0806 02:20:31.140165 (+ 1036us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:31.140181 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:31.140336 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:31.140941 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:31.140943 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:31.140955 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:31.141161 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:31.141169 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.142717 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.142720 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:31.144126 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:31.144138 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.145162 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.145165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:31.145260 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.145292 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 02:20:31.145367 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 02:20:31.145479 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":934,"mutex_wait_us":353,"thread_start_us":101,"threads_started":1}
I20260806 02:20:31.152822 16538 tablet_service.cc:1467] Processing CreateTablet for tablet 78e068c68c67443e895636395a930740 (DEFAULT_TABLE table=test-table [id=a8e0eb32a476487d9547eded3d4b78f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:31.152869 16709 tablet_service.cc:1467] Processing CreateTablet for tablet 78e068c68c67443e895636395a930740 (DEFAULT_TABLE table=test-table [id=a8e0eb32a476487d9547eded3d4b78f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:31.153929 16709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78e068c68c67443e895636395a930740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:31.153991 16538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78e068c68c67443e895636395a930740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:31.157817 16998 tablet_bootstrap.cc:492] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784: Bootstrap starting.
I20260806 02:20:31.160373 17001 tablet_bootstrap.cc:492] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c: Bootstrap starting.
I20260806 02:20:31.160892 16998 tablet_bootstrap.cc:654] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:31.161669 17002 tablet_bootstrap.cc:492] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Bootstrap starting.
I20260806 02:20:31.162436 16998 log.cc:824] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:31.162983 17001 tablet_bootstrap.cc:654] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:31.163894 17002 tablet_bootstrap.cc:654] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:31.163914 17001 log.cc:824] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:31.164685 17002 log.cc:824] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:31.165220 16998 tablet_bootstrap.cc:492] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784: No bootstrap required, opened a new log
I20260806 02:20:31.165479 16998 ts_tablet_manager.cc:1397] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s
I20260806 02:20:31.165844 17001 tablet_bootstrap.cc:492] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c: No bootstrap required, opened a new log
I20260806 02:20:31.166041 17001 ts_tablet_manager.cc:1397] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:20:31.166779 17002 tablet_bootstrap.cc:492] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: No bootstrap required, opened a new log
I20260806 02:20:31.166957 17002 ts_tablet_manager.cc:1397] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.001s
I20260806 02:20:31.169485 17001 raft_consensus.cc:348] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } } peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } }
I20260806 02:20:31.169832 17001 raft_consensus.cc:374] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:31.169901 17001 raft_consensus.cc:729] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b9e564a3ad04418ad3686c04d53cb6c, State: Initialized, Role: FOLLOWER
I20260806 02:20:31.169818 16998 raft_consensus.cc:348] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } } peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } }
I20260806 02:20:31.170079 16998 raft_consensus.cc:374] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:31.170131 16998 raft_consensus.cc:729] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b3e8c1e07784fcb9aa4a09f43d14784, State: Initialized, Role: FOLLOWER
I20260806 02:20:31.170432 17001 consensus_queue.cc:260] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } } peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } }
I20260806 02:20:31.170608 16998 consensus_queue.cc:260] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } } peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } }
I20260806 02:20:31.171357 16976 heartbeater.cc:503] Master 127.26.189.190:36853 was elected leader, sending a full tablet report...
I20260806 02:20:31.171563 17001 ts_tablet_manager.cc:1428] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 02:20:31.171602 16998 ts_tablet_manager.cc:1428] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260806 02:20:31.171952 16797 heartbeater.cc:503] Master 127.26.189.190:36853 was elected leader, sending a full tablet report...
I20260806 02:20:31.173131 17002 raft_consensus.cc:348] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } } peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } }
I20260806 02:20:31.173379 17002 raft_consensus.cc:374] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:31.173445 17002 raft_consensus.cc:729] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca1a63f5be445bb82013fa3d1842e58, State: Initialized, Role: FOLLOWER
I20260806 02:20:31.173910 17002 consensus_queue.cc:260] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } } peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } }
I20260806 02:20:31.174540 16626 heartbeater.cc:503] Master 127.26.189.190:36853 was elected leader, sending a full tablet report...
I20260806 02:20:31.175118 17002 ts_tablet_manager.cc:1428] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Time spent starting tablet: real 0.008s user 0.005s sys 0.002s
I20260806 02:20:31.239974 17008 raft_consensus.cc:482] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:31.240252 17008 raft_consensus.cc:504] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } } peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } }
I20260806 02:20:31.241454 17008 leader_election.cc:288] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca1a63f5be445bb82013fa3d1842e58 (127.26.189.129:38291), 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173)
I20260806 02:20:31.246340 16799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.241889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38291 (local address 127.26.189.130:55671)
0806 02:20:31.242090 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:31.242114 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:31.242229 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:31.242746 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:31.242750 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:31.242771 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:31.242911 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:31.242917 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.243870 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.243874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:31.245089 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:31.245100 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.245940 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.245944 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:31.246041 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.246062 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 02:20:31.246128 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 02:20:31.246187 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 02:20:31.246398 16991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.242011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:55671 (local address 127.26.189.129:38291)
0806 02:20:31.242145 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:31.242149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:31.242165 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:20:31.242558 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:31.242564 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:31.242624 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:31.242721 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:31.243032 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.243749 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.245228 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.245808 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.245928 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.245996 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:31.246180 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 02:20:31.246272 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 02:20:31.246825 16997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.242413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:44485 (local address 127.26.189.131:45173)
0806 02:20:31.242539 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:31.242543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:31.242899 (+ 356us) server_negotiation.cc:407] Connection header received
0806 02:20:31.243067 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:31.243070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:31.243120 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:31.243235 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:31.243529 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.244194 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.245489 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.246171 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.246302 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.246348 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:31.246595 (+ 247us) server_negotiation.cc:299] Negotiation successful
0806 02:20:31.246706 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 02:20:31.247162 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.242251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:45173 (local address 127.26.189.130:44485)
0806 02:20:31.242793 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:31.242805 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:31.242934 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:31.243271 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:31.243274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:31.243294 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:31.243405 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:31.243411 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.244301 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.244304 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:31.245377 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:31.245385 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.246315 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.246318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:31.246432 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.246455 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 02:20:31.246980 (+ 525us) client_negotiation.cc:240] Negotiation successful
0806 02:20:31.247062 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":325,"threads_started":1}
I20260806 02:20:31.247272 16560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e068c68c67443e895636395a930740" candidate_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca1a63f5be445bb82013fa3d1842e58" is_pre_election: true
I20260806 02:20:31.247638 16560 raft_consensus.cc:2454] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b9e564a3ad04418ad3686c04d53cb6c in term 0.
I20260806 02:20:31.247799 16912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e068c68c67443e895636395a930740" candidate_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" is_pre_election: true
I20260806 02:20:31.248080 16912 raft_consensus.cc:2454] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b9e564a3ad04418ad3686c04d53cb6c in term 0.
I20260806 02:20:31.248211 16652 leader_election.cc:302] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b9e564a3ad04418ad3686c04d53cb6c, 7ca1a63f5be445bb82013fa3d1842e58; no voters:
I20260806 02:20:31.248538 17008 raft_consensus.cc:2781] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:20:31.248641 17008 raft_consensus.cc:482] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:20:31.248698 17008 raft_consensus.cc:3037] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:31.249845 17008 raft_consensus.cc:504] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } } peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } }
I20260806 02:20:31.250187 17008 leader_election.cc:288] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [CANDIDATE]: Term 1 election: Requested vote from peers 7ca1a63f5be445bb82013fa3d1842e58 (127.26.189.129:38291), 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173)
I20260806 02:20:31.250571 16560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e068c68c67443e895636395a930740" candidate_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca1a63f5be445bb82013fa3d1842e58"
I20260806 02:20:31.250629 16912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e068c68c67443e895636395a930740" candidate_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784"
I20260806 02:20:31.250690 16560 raft_consensus.cc:3037] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:31.250806 16912 raft_consensus.cc:3037] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:31.251906 16560 raft_consensus.cc:2454] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b9e564a3ad04418ad3686c04d53cb6c in term 1.
I20260806 02:20:31.252084 16912 raft_consensus.cc:2454] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b9e564a3ad04418ad3686c04d53cb6c in term 1.
I20260806 02:20:31.252267 16652 leader_election.cc:302] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b9e564a3ad04418ad3686c04d53cb6c, 7ca1a63f5be445bb82013fa3d1842e58; no voters:
I20260806 02:20:31.252468 17008 raft_consensus.cc:2781] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:20:31.252755 17008 raft_consensus.cc:686] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 1 LEADER]: Becoming Leader. State: Replica: 5b9e564a3ad04418ad3686c04d53cb6c, State: Running, Role: LEADER
I20260806 02:20:31.253114 17008 consensus_queue.cc:237] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } } peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } }
I20260806 02:20:31.256531 16364 catalog_manager.cc:5495] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130). New cstate: current_term: 1 leader_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } health_report { overall_health: UNKNOWN } } }
I20260806 02:20:31.278853 16994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.273568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56536 (local address 127.26.189.130:45199)
0806 02:20:31.273707 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:31.273712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:31.273817 (+ 105us) server_negotiation.cc:407] Connection header received
0806 02:20:31.274042 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:31.274050 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:31.274139 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:31.274319 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:20:31.274625 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.275608 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.276954 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:31.277277 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:31.277390 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:31.277784 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:20:31.278408 (+ 624us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:20:31.278541 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:31.278628 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 02:20:31.278683 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 02:20:31.285157 16912 raft_consensus.cc:1261] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 1 FOLLOWER]: Refusing update from remote peer 5b9e564a3ad04418ad3686c04d53cb6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:20:31.285157 16560 raft_consensus.cc:1261] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Refusing update from remote peer 5b9e564a3ad04418ad3686c04d53cb6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:20:31.285905 17008 consensus_queue.cc:1035] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:20:31.286098 17013 consensus_queue.cc:1035] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:20:31.296249 17019 mvcc.cc:205] Tried to move back new op lower bound from 7315385676935720960 to 7315385676816166912. Current Snapshot: MvccSnapshot[applied={T|T < 7315385676935720960}]
I20260806 02:20:31.297461 17018 mvcc.cc:205] Tried to move back new op lower bound from 7315385676935720960 to 7315385676816166912. Current Snapshot: MvccSnapshot[applied={T|T < 7315385676935720960 or (T in {7315385676935720960})}]
I20260806 02:20:31.303988 16364 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:20:31.304172 16364 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:20:31.306685 16364 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Sending DeleteTablet for 3 replicas of tablet 78e068c68c67443e895636395a930740
I20260806 02:20:31.307581 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 16444
I20260806 02:20:31.307525 16538 tablet_service.cc:1514] Processing DeleteTablet for tablet 78e068c68c67443e895636395a930740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:31 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:45244
I20260806 02:20:31.307685 16709 tablet_service.cc:1514] Processing DeleteTablet for tablet 78e068c68c67443e895636395a930740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:31 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:56526
I20260806 02:20:31.308188 16884 tablet_service.cc:1514] Processing DeleteTablet for tablet 78e068c68c67443e895636395a930740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:31 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:57538
I20260806 02:20:31.318753 17030 tablet_replica.cc:330] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c: stopping tablet replica
I20260806 02:20:31.319278 17030 raft_consensus.cc:2229] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:20:31.319948 17030 raft_consensus.cc:2258] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:31.322986 17030 ts_tablet_manager.cc:1905] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:20:31.327312 17030 ts_tablet_manager.cc:1918] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:20:31.327436 17030 log.cc:1196] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/78e068c68c67443e895636395a930740
I20260806 02:20:31.327934 17030 ts_tablet_manager.cc:1939] T 78e068c68c67443e895636395a930740 P 5b9e564a3ad04418ad3686c04d53cb6c: Deleting consensus metadata
I20260806 02:20:31.330300 16345 catalog_manager.cc:4841] TS 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199): tablet 78e068c68c67443e895636395a930740 (table test-table [id=a8e0eb32a476487d9547eded3d4b78f1]) successfully deleted
I20260806 02:20:31.331179 17031 tablet_replica.cc:330] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784: stopping tablet replica
I20260806 02:20:31.331669 17031 raft_consensus.cc:2229] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:20:31.332016 17031 raft_consensus.cc:2258] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:31.333598 17031 ts_tablet_manager.cc:1905] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:20:31.336318 17031 ts_tablet_manager.cc:1918] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:20:31.336410 17031 log.cc:1196] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/78e068c68c67443e895636395a930740
I20260806 02:20:31.336750 17031 ts_tablet_manager.cc:1939] T 78e068c68c67443e895636395a930740 P 1b3e8c1e07784fcb9aa4a09f43d14784: Deleting consensus metadata
W20260806 02:20:31.337919 16343 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:38291 (error 108)
I20260806 02:20:31.338054 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 16631
I20260806 02:20:31.338685 16343 catalog_manager.cc:4841] TS 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173): tablet 78e068c68c67443e895636395a930740 (table test-table [id=a8e0eb32a476487d9547eded3d4b78f1]) successfully deleted
I20260806 02:20:31.344058 16992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:31.343713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38291 (local address 127.0.0.1:45260)
0806 02:20:31.343914 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:31.343984 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
W20260806 02:20:31.344215 16343 catalog_manager.cc:4584] TS 7ca1a63f5be445bb82013fa3d1842e58 (127.26.189.129:38291): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 78e068c68c67443e895636395a930740: Network error: Client connection negotiation failed: client connection to 127.26.189.129:38291: connect: Connection refused (error 111)
I20260806 02:20:31.352651 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 16803
I20260806 02:20:31.368958 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 16318
I20260806 02:20:51.382436 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:36853
--webserver_interface=127.26.189.190
--webserver_port=43915
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:36853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:20:51.507575 17033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:51.507884 17033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:51.507928 17033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:51.512035 17033 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 02:20:51.512101 17033 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 02:20:51.512120 17033 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 02:20:51.512138 17033 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:20:51.512159 17033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:51.512180 17033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:51.512200 17033 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:20:51.512225 17033 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:20:51.517753 17033 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:36853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:36853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=43915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:51.518785 17033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:51.519778 17033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:51.534119 17048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:51.534313 17044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:51.534119 17045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:51.534523 17033 server_base.cc:1034] running on GCE node
I20260806 02:20:51.535243 17033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:51.536486 17033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:51.537694 17033 hybrid_clock.cc:648] HybridClock initialized: now 1785982851537677 us; error 27 us; skew 500 ppm
Aug 06 02:20:51 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982851, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:51.544818 17033 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:20:51.545915 17033 webserver.cc:460] Webserver started at http://127.26.189.190:43915/ using document root <none> and password file <none>
I20260806 02:20:51.546567 17033 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:51.546679 17033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:51.550711 17033 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260806 02:20:51.553103 17055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:51.554788 17033 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 02:20:51.554942 17033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "4114891c70c24e0385d8d436ea5aded0"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "3b5c4eb086c399cd31776be7f90270ba"
server_key_iv: "e371964f5eb9ef2a0fca8e3fbed25680"
server_key_version: "encryptionkey@0"
I20260806 02:20:51.555585 17033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:51.567884 17033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:51.570829 17033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:51.571043 17033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:51.578749 17033 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:36853
I20260806 02:20:51.579054 17126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:36853 every 8 connection(s)
I20260806 02:20:51.579913 17033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:20:51.581672 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 17033
I20260806 02:20:51.582168 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:38291
--local_ip_for_outbound_sockets=127.26.189.129
--tserver_master_addrs=127.26.189.190:36853
--webserver_port=45255
--webserver_interface=127.26.189.129
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:20:51.584654 17127 sys_catalog.cc:263] Verifying existing consensus state
I20260806 02:20:51.586457 17127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Bootstrap starting.
I20260806 02:20:51.605212 17127 log.cc:824] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:51.614336 17127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 02:20:51.614743 17127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Bootstrap complete.
I20260806 02:20:51.618963 17127 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } }
I20260806 02:20:51.619393 17127 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4114891c70c24e0385d8d436ea5aded0, State: Initialized, Role: FOLLOWER
I20260806 02:20:51.619905 17127 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } }
I20260806 02:20:51.620091 17127 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:20:51.620182 17127 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:20:51.620309 17127 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 1 FOLLOWER]: Advancing to term 2
I20260806 02:20:51.622290 17127 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } }
I20260806 02:20:51.622623 17127 leader_election.cc:302] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4114891c70c24e0385d8d436ea5aded0; no voters:
I20260806 02:20:51.622970 17127 leader_election.cc:288] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 02:20:51.623055 17131 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 02:20:51.623239 17131 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 2 LEADER]: Becoming Leader. State: Replica: 4114891c70c24e0385d8d436ea5aded0, State: Running, Role: LEADER
I20260806 02:20:51.623589 17131 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } }
I20260806 02:20:51.624235 17127 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:20:51.625105 17138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4114891c70c24e0385d8d436ea5aded0. Latest consensus state: current_term: 2 leader_uuid: "4114891c70c24e0385d8d436ea5aded0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } } }
I20260806 02:20:51.625159 17136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4114891c70c24e0385d8d436ea5aded0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } } }
I20260806 02:20:51.625365 17138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:51.625370 17136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: This master's current role is: LEADER
I20260806 02:20:51.626235 17146 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:20:51.631537 17146 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:20:51.632244 17146 catalog_manager.cc:1259] Loaded cluster ID: 876f9bd5b44048d4a0f678d7565b2403
I20260806 02:20:51.632305 17146 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:20:51.634712 17146 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:20:51.635404 17146 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Loaded TSK: 0
I20260806 02:20:51.649421 17146 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Generated new TSK 1
I20260806 02:20:51.649843 17146 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 02:20:51.709019 17129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:51.709287 17129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:51.709333 17129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:51.713644 17129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:51.713706 17129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:51.713804 17129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:20:51.719280 17129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:38291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=45255
--tserver_master_addrs=127.26.189.190:36853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:51.720333 17129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:51.721385 17129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:51.731595 17164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:51.731810 17163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:51.731593 17168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:51.732273 17129 server_base.cc:1034] running on GCE node
I20260806 02:20:51.732772 17129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:51.733608 17129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:51.734826 17129 hybrid_clock.cc:648] HybridClock initialized: now 1785982851734792 us; error 42 us; skew 500 ppm
Aug 06 02:20:51 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982851, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:51.738317 17129 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:20:51.739293 17129 webserver.cc:460] Webserver started at http://127.26.189.129:45255/ using document root <none> and password file <none>
I20260806 02:20:51.739874 17129 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:51.739992 17129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:51.744135 17129 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260806 02:20:51.746520 17176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:51.747884 17129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 02:20:51.748025 17129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "7ca1a63f5be445bb82013fa3d1842e58"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "09157d8a6b08be6cb02f9d40c6a1b121"
server_key_iv: "2c3ab789b0726c54297b5d8a54ef389b"
server_key_version: "encryptionkey@0"
I20260806 02:20:51.748581 17129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:51.764982 17129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:51.768472 17129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:51.768739 17129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:51.769428 17129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:51.770854 17184 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 02:20:51.776297 17129 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 02:20:51.776405 17129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260806 02:20:51.776501 17129 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 02:20:51.778450 17129 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 02:20:51.778525 17129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260806 02:20:51.778846 17184 tablet_bootstrap.cc:492] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Bootstrap starting.
I20260806 02:20:51.789979 17129 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:38291
I20260806 02:20:51.790243 17334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:38291 every 8 connection(s)
I20260806 02:20:51.791045 17129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:20:51.800374 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 17129
I20260806 02:20:51.800851 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:45199
--local_ip_for_outbound_sockets=127.26.189.130
--tserver_master_addrs=127.26.189.190:36853
--webserver_port=46803
--webserver_interface=127.26.189.130
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:20:51.801313 17184 log.cc:824] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Log is configured to *not* fsync() on all Append() calls
Aug 06 02:20:51 dist-test-slave-gkw7 krb5kdc[16300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982851, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:51.810357 17339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:51.793455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:40321 (local address 127.26.189.190:36853)
0806 02:20:51.793981 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:51.794001 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:51.794218 (+ 217us) server_negotiation.cc:407] Connection header received
0806 02:20:51.795782 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:51.795794 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:51.796211 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:51.796508 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:51.798356 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:51.799371 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:51.801029 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:51.801835 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:51.802083 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:51.804947 (+ 2864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:51.804953 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:51.804966 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:51.804994 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:51.806932 (+ 1938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:51.807487 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:51.807512 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:51.807517 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:51.807641 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:51.808007 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:51.808010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:51.808012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:51.808386 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:51.808537 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:51.809162 (+ 625us) server_negotiation.cc:299] Negotiation successful
0806 02:20:51.809445 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":160,"threads_started":1}
I20260806 02:20:51.810374 17338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:51.793309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:40321)
0806 02:20:51.793973 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:51.794068 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:51.795286 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:51.796647 (+ 1361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:51.796656 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:51.797345 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:51.798159 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:51.798184 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:51.799557 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:51.799561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:51.800857 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:51.800872 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:51.802016 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:51.802022 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:51.802303 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:51.803018 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:51.803041 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:51.804737 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:51.807062 (+ 2325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:51.807068 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:51.807082 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:51.807358 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:51.807744 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:51.807750 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:51.807753 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:51.807897 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:51.808508 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:51.808514 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:51.808796 (+ 282us) client_negotiation.cc:769] Sending connection context
0806 02:20:51.809015 (+ 219us) client_negotiation.cc:240] Negotiation successful
0806 02:20:51.809368 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":26,"thread_start_us":186,"threads_started":1}
I20260806 02:20:51.811714 17184 tablet_bootstrap.cc:492] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 02:20:51.812252 17184 tablet_bootstrap.cc:492] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Bootstrap complete.
I20260806 02:20:51.813436 17336 heartbeater.cc:347] Connected to a master server at 127.26.189.190:36853
I20260806 02:20:51.813786 17336 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:51.814105 17184 ts_tablet_manager.cc:1397] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Time spent bootstrapping tablet: real 0.035s user 0.022s sys 0.012s
I20260806 02:20:51.814445 17336 heartbeater.cc:511] Master 127.26.189.190:36853 requested a full tablet report, sending...
I20260806 02:20:51.817135 17074 ts_manager.cc:194] Registered new tserver with Master: 7ca1a63f5be445bb82013fa3d1842e58 (127.26.189.129:38291)
I20260806 02:20:51.818205 17184 raft_consensus.cc:348] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } } peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } }
I20260806 02:20:51.818792 17184 raft_consensus.cc:729] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca1a63f5be445bb82013fa3d1842e58, State: Initialized, Role: FOLLOWER
I20260806 02:20:51.819336 17184 consensus_queue.cc:260] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } } peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } }
I20260806 02:20:51.820384 17184 ts_tablet_manager.cc:1428] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260806 02:20:51.821357 17074 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:40321
I20260806 02:20:51.824469 17336 heartbeater.cc:503] Master 127.26.189.190:36853 was elected leader, sending a full tablet report...
Aug 06 02:20:51 dist-test-slave-gkw7 krb5kdc[16300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982851, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.129@KRBTEST.COM
I20260806 02:20:51.833690 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:51.820577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38291 (local address 127.0.0.1:50058)
0806 02:20:51.821016 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:51.821068 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:51.821214 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:51.822250 (+ 1036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:51.822256 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:51.822707 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:51.822845 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:51.822853 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:51.824653 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:51.824658 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:51.825761 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:51.825777 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:51.826699 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:51.826701 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:51.826836 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:51.827502 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:51.827520 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:51.829310 (+ 1790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:51.831776 (+ 2466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:51.831785 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:51.831790 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:51.832040 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:51.832398 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:51.832400 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:51.832401 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:51.832487 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:51.833046 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:51.833051 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:51.833169 (+ 118us) client_negotiation.cc:769] Sending connection context
0806 02:20:51.833296 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 02:20:51.833466 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":117,"threads_started":1}
I20260806 02:20:51.833827 17349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:51.821392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50058 (local address 127.26.189.129:38291)
0806 02:20:51.821738 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:51.821750 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:51.821773 (+ 23us) server_negotiation.cc:407] Connection header received
0806 02:20:51.821860 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:51.821865 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:51.822060 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:51.823003 (+ 943us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:51.823120 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:51.824484 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:51.825943 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:51.826571 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:51.826699 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:51.829468 (+ 2769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:51.829480 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:51.829494 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:51.829524 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:51.831633 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:51.832166 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:51.832174 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:51.832178 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:51.832290 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:51.832586 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:51.832589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:51.832591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:51.832914 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:51.833073 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:51.833416 (+ 343us) server_negotiation.cc:299] Negotiation successful
0806 02:20:51.833640 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":247,"thread_start_us":100,"threads_started":1}
I20260806 02:20:51.835078 17249 tablet_service.cc:1514] Processing DeleteTablet for tablet 78e068c68c67443e895636395a930740 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:31 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:50058
I20260806 02:20:51.836156 17350 tablet_replica.cc:330] stopping tablet replica
I20260806 02:20:51.836488 17350 raft_consensus.cc:2229] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:20:51.836767 17350 raft_consensus.cc:2258] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:51.837917 17350 ts_tablet_manager.cc:1905] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:20:51.841868 17350 ts_tablet_manager.cc:1918] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:20:51.841997 17350 log.cc:1196] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal/wals/78e068c68c67443e895636395a930740
I20260806 02:20:51.842308 17350 ts_tablet_manager.cc:1939] T 78e068c68c67443e895636395a930740 P 7ca1a63f5be445bb82013fa3d1842e58: Deleting consensus metadata
I20260806 02:20:51.844164 17057 catalog_manager.cc:4841] TS 7ca1a63f5be445bb82013fa3d1842e58 (127.26.189.129:38291): tablet 78e068c68c67443e895636395a930740 (table test-table [id=a8e0eb32a476487d9547eded3d4b78f1]) successfully deleted
W20260806 02:20:51.932453 17344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:51.932783 17344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:51.932832 17344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:51.936910 17344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:51.936992 17344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:51.937055 17344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:20:51.942632 17344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:45199
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=46803
--tserver_master_addrs=127.26.189.190:36853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:51.943725 17344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:51.944777 17344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:51.954972 17356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:51.955149 17344 server_base.cc:1034] running on GCE node
W20260806 02:20:51.954972 17357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:51.954988 17359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:51.955798 17344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:51.956540 17344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:51.957764 17344 hybrid_clock.cc:648] HybridClock initialized: now 1785982851957749 us; error 26 us; skew 500 ppm
Aug 06 02:20:51 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982851, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:51.961140 17344 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:20:51.962167 17344 webserver.cc:460] Webserver started at http://127.26.189.130:46803/ using document root <none> and password file <none>
I20260806 02:20:51.962800 17344 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:51.962934 17344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:51.967185 17344 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:20:51.969412 17368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:51.970863 17344 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:51.971004 17344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "5b9e564a3ad04418ad3686c04d53cb6c"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "5b2f2fca923e1bb2d200a61b89358bd7"
server_key_iv: "8ea243de0ce9af7bf9f5c6f43a839357"
server_key_version: "encryptionkey@0"
I20260806 02:20:51.971624 17344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:52.000084 17344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:52.003595 17344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:52.003829 17344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:52.004509 17344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:52.005451 17344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:52.005533 17344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:52.005669 17344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:52.005728 17344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:52.017390 17344 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:45199
I20260806 02:20:52.017409 17522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:45199 every 8 connection(s)
I20260806 02:20:52.018553 17344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:20:52.021763 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 17344
I20260806 02:20:52.022377 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:45173
--local_ip_for_outbound_sockets=127.26.189.131
--tserver_master_addrs=127.26.189.190:36853
--webserver_port=43013
--webserver_interface=127.26.189.131
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 02:20:52 dist-test-slave-gkw7 krb5kdc[16300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982851, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:52.035197 17339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.020699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:42043 (local address 127.26.189.190:36853)
0806 02:20:52.020849 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:52.020853 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:52.022208 (+ 1355us) server_negotiation.cc:407] Connection header received
0806 02:20:52.023641 (+ 1433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:52.023645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:52.023698 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:52.023829 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:52.025264 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.025884 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.027168 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.027530 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.027661 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.030873 (+ 3212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:52.030876 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:52.030878 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:52.030905 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:52.032573 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:52.033284 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:52.033287 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:52.033289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:52.033372 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:52.033870 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:52.033874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:52.033875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:52.034089 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:52.034180 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:52.034924 (+ 744us) server_negotiation.cc:299] Negotiation successful
0806 02:20:52.035050 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:20:52.036417 17526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.021158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:42043)
0806 02:20:52.022018 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:52.022080 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:52.023376 (+ 1296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:52.024001 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:52.024013 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:52.024540 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:52.025110 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:52.025126 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.026019 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.026023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:52.027027 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:52.027038 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.027709 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.027713 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:52.027904 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.028581 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:52.028613 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:52.030666 (+ 2053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:52.032711 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:52.032720 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:52.032743 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:52.033163 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:52.033474 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:52.033479 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:52.033483 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:52.033740 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:52.034215 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:52.034226 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:52.034609 (+ 383us) client_negotiation.cc:769] Sending connection context
0806 02:20:52.034874 (+ 265us) client_negotiation.cc:240] Negotiation successful
0806 02:20:52.035291 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":115,"threads_started":1}
I20260806 02:20:52.037735 17523 heartbeater.cc:347] Connected to a master server at 127.26.189.190:36853
I20260806 02:20:52.038002 17523 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:52.038545 17523 heartbeater.cc:511] Master 127.26.189.190:36853 requested a full tablet report, sending...
I20260806 02:20:52.039631 17074 ts_manager.cc:194] Registered new tserver with Master: 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199)
I20260806 02:20:52.040230 17074 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:42043
W20260806 02:20:52.141124 17527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:20:52.141427 17527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:20:52.141520 17527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:20:52.145639 17527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:20:52.145720 17527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:20:52.145810 17527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:20:52.151539 17527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:45173
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=43013
--tserver_master_addrs=127.26.189.190:36853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:20:52.152679 17527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:20:52.153836 17527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:20:52.163688 17539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:52.163700 17535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:20:52.163699 17533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:20:52.163950 17527 server_base.cc:1034] running on GCE node
I20260806 02:20:52.164561 17527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:20:52.165247 17527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:20:52.166412 17527 hybrid_clock.cc:648] HybridClock initialized: now 1785982852166353 us; error 65 us; skew 500 ppm
Aug 06 02:20:52 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982852, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:20:52.169446 17527 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:20:52.170413 17527 webserver.cc:460] Webserver started at http://127.26.189.131:43013/ using document root <none> and password file <none>
I20260806 02:20:52.170940 17527 fs_manager.cc:359] Metadata directory not provided
I20260806 02:20:52.171015 17527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:20:52.174871 17527 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:52.177301 17549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:52.178711 17527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:20:52.178850 17527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "1b3e8c1e07784fcb9aa4a09f43d14784"
format_stamp: "Formatted at 2026-08-06 02:20:31 on dist-test-slave-gkw7"
server_key: "48620602c7d8a3933eff0cbdbd816205"
server_key_iv: "bf5096b5af48567ff7f0391224f5f967"
server_key_version: "encryptionkey@0"
I20260806 02:20:52.179479 17527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:20:52.213923 17527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:20:52.217787 17527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:20:52.218016 17527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:20:52.218704 17527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:20:52.219616 17527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:20:52.219694 17527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:52.219789 17527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:20:52.219846 17527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:20:52.229915 17527 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:45173
I20260806 02:20:52.229943 17702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:45173 every 8 connection(s)
I20260806 02:20:52.230991 17527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:20:52.240921 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 17527
Aug 06 02:20:52 dist-test-slave-gkw7 krb5kdc[16300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982852, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:20:52.246371 17339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.232940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:46771 (local address 127.26.189.190:36853)
0806 02:20:52.233137 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:52.233143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:52.234597 (+ 1454us) server_negotiation.cc:407] Connection header received
0806 02:20:52.235602 (+ 1005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:52.235605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:52.235661 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:52.235744 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:52.237047 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.237693 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.238866 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.239108 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.239232 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.242155 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:52.242159 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:52.242161 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:52.242187 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:52.243830 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:52.244417 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:52.244422 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:52.244424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:52.244517 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:52.244906 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:52.244910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:52.244912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:52.245140 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:52.245262 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:52.245971 (+ 709us) server_negotiation.cc:299] Negotiation successful
0806 02:20:52.246134 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76,"spinlock_wait_cycles":23296}
I20260806 02:20:52.247233 17707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.233355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:46771)
0806 02:20:52.234354 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:52.234419 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:52.235398 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:52.235958 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:52.235964 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:52.236373 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:20:52.236872 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:52.236886 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.237817 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.237820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:52.238740 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:52.238750 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.239279 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.239281 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:52.239423 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.240014 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:20:52.240030 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:20:52.241933 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:20:52.243982 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:52.243989 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:52.244005 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:52.244298 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:52.244622 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:20:52.244635 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:20:52.244637 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:20:52.244797 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:20:52.245261 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:20:52.245269 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:20:52.245612 (+ 343us) client_negotiation.cc:769] Sending connection context
0806 02:20:52.245885 (+ 273us) client_negotiation.cc:240] Negotiation successful
0806 02:20:52.246207 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"thread_start_us":204,"threads_started":1}
I20260806 02:20:52.248585 17703 heartbeater.cc:347] Connected to a master server at 127.26.189.190:36853
I20260806 02:20:52.248883 17703 heartbeater.cc:464] Registering TS with master...
I20260806 02:20:52.249610 17703 heartbeater.cc:511] Master 127.26.189.190:36853 requested a full tablet report, sending...
I20260806 02:20:52.250705 17709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.241697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35320 (local address 127.26.189.190:36853)
0806 02:20:52.241999 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:52.242006 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:52.242114 (+ 108us) server_negotiation.cc:407] Connection header received
0806 02:20:52.242273 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:52.242276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:52.242328 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:52.242423 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:52.243164 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.243693 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.244581 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.244832 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.244938 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.246806 (+ 1868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:52.246810 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:52.246812 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:52.246837 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:52.248557 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:52.249038 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:52.249041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:52.249042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:52.249124 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:52.249477 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:52.249481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:52.249482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:52.249861 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:52.250052 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:52.250312 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 02:20:52.250471 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":107,"threads_started":1}
I20260806 02:20:52.250905 17074 ts_manager.cc:194] Registered new tserver with Master: 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173)
I20260806 02:20:52.251597 17074 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:46771
I20260806 02:20:52.253010 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:20:52.257694 17709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.253962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35336 (local address 127.26.189.190:36853)
0806 02:20:52.254086 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:52.254091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:52.254350 (+ 259us) server_negotiation.cc:407] Connection header received
0806 02:20:52.254539 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:52.254542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:52.254639 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:52.254752 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:20:52.254998 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.255530 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.256470 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.256711 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.256817 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.257140 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:20:52.257271 (+ 131us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 02:20:52.257534 (+ 263us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35336: token expired
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 02:20:52.257789 17709 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35336: token expired
W20260806 02:20:52.258098 16980 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.189.190:36853)
I20260806 02:20:52.265591 17709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.258493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35346 (local address 127.26.189.190:36853)
0806 02:20:52.258607 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:52.258611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:52.258627 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:20:52.258687 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:52.258707 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:52.258740 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:52.258802 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:20:52.259500 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.260059 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.260874 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.261072 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.261147 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.262579 (+ 1432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:20:52.262582 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:20:52.262584 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:20:52.262605 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:20:52.264016 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:52.264474 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:52.264476 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:52.264478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:52.264552 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:20:52.264824 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:20:52.264826 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:20:52.264827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:20:52.264985 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:20:52.265084 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:52.265316 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 02:20:52.265413 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 02:20:52.268059 17074 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:20:52.271442 17074 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:20:52.280035 17249 tablet_service.cc:1467] Processing CreateTablet for tablet ff0ae43dde5844b193d8892b3d61a6b8 (DEFAULT_TABLE table=test-table [id=422e6a5ef22a4769b69b234768ac2e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:52.280763 17249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff0ae43dde5844b193d8892b3d61a6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:52.283629 17184 tablet_bootstrap.cc:492] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: Bootstrap starting.
I20260806 02:20:52.284559 17184 tablet_bootstrap.cc:654] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:52.284761 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.278805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:45199 (local address 127.0.0.1:49224)
0806 02:20:52.278947 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:52.278964 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:52.279048 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:52.279965 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:52.279968 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:52.279987 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:52.280095 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:52.280101 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.282068 (+ 1967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.282071 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:52.283091 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:52.283102 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.284307 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.284310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:52.284419 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.284471 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 02:20:52.284538 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 02:20:52.284624 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":156}
I20260806 02:20:52.284837 17715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.279005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49224 (local address 127.26.189.130:45199)
0806 02:20:52.279383 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:52.279397 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:52.279422 (+ 25us) server_negotiation.cc:407] Connection header received
0806 02:20:52.279509 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:52.279518 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:52.279774 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:52.280462 (+ 688us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:52.280651 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.281922 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.283275 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.284185 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.284323 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.284539 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:52.284593 (+ 54us) server_negotiation.cc:299] Negotiation successful
0806 02:20:52.284697 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":175,"threads_started":1}
I20260806 02:20:52.285696 17716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.279103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:45173 (local address 127.0.0.1:53484)
0806 02:20:52.279487 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:52.279500 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:52.279584 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:52.280352 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:52.280357 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:52.280378 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:52.280492 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:52.280498 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.282079 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.282082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:52.283413 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:52.283424 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.285243 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.285247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:52.285345 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.285368 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 02:20:52.285453 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 02:20:52.285518 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":32,"thread_start_us":112,"threads_started":1}
I20260806 02:20:52.286128 17718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.279391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53484 (local address 127.26.189.131:45173)
0806 02:20:52.279855 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:52.279868 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:52.279891 (+ 23us) server_negotiation.cc:407] Connection header received
0806 02:20:52.279970 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:52.279975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:52.280192 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:52.280660 (+ 468us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:52.280823 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.281956 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.283567 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.284793 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.285256 (+ 463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.285377 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:52.285881 (+ 504us) server_negotiation.cc:299] Negotiation successful
0806 02:20:52.285963 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":159,"threads_started":1}
I20260806 02:20:52.286185 17184 tablet_bootstrap.cc:492] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: No bootstrap required, opened a new log
I20260806 02:20:52.286267 17184 ts_tablet_manager.cc:1397] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260806 02:20:52.286715 17184 raft_consensus.cc:348] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:20:52.286846 17184 raft_consensus.cc:374] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:52.286886 17184 raft_consensus.cc:729] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca1a63f5be445bb82013fa3d1842e58, State: Initialized, Role: FOLLOWER
I20260806 02:20:52.287012 17184 consensus_queue.cc:260] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:20:52.287266 17184 ts_tablet_manager.cc:1428] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 02:20:52.288452 17410 tablet_service.cc:1467] Processing CreateTablet for tablet ff0ae43dde5844b193d8892b3d61a6b8 (DEFAULT_TABLE table=test-table [id=422e6a5ef22a4769b69b234768ac2e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:52.289638 17410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff0ae43dde5844b193d8892b3d61a6b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260806 02:20:52.292210 17337 tablet.cc:2369] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:20:52.292186 17616 tablet_service.cc:1467] Processing CreateTablet for tablet ff0ae43dde5844b193d8892b3d61a6b8 (DEFAULT_TABLE table=test-table [id=422e6a5ef22a4769b69b234768ac2e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:20:52.293200 17616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff0ae43dde5844b193d8892b3d61a6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:20:52.296919 17720 tablet_bootstrap.cc:492] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c: Bootstrap starting.
I20260806 02:20:52.299338 17720 tablet_bootstrap.cc:654] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:52.299755 17721 tablet_bootstrap.cc:492] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784: Bootstrap starting.
I20260806 02:20:52.300261 17720 log.cc:824] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:52.302475 17721 tablet_bootstrap.cc:654] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784: Neither blocks nor log segments found. Creating new log.
I20260806 02:20:52.302866 17720 tablet_bootstrap.cc:492] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c: No bootstrap required, opened a new log
I20260806 02:20:52.303066 17720 ts_tablet_manager.cc:1397] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 02:20:52.303332 17721 log.cc:824] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784: Log is configured to *not* fsync() on all Append() calls
I20260806 02:20:52.305398 17721 tablet_bootstrap.cc:492] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784: No bootstrap required, opened a new log
I20260806 02:20:52.305629 17721 ts_tablet_manager.cc:1397] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:20:52.307013 17720 raft_consensus.cc:348] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:20:52.307310 17720 raft_consensus.cc:374] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:52.307374 17720 raft_consensus.cc:729] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b9e564a3ad04418ad3686c04d53cb6c, State: Initialized, Role: FOLLOWER
I20260806 02:20:52.307857 17720 consensus_queue.cc:260] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:20:52.308604 17523 heartbeater.cc:503] Master 127.26.189.190:36853 was elected leader, sending a full tablet report...
I20260806 02:20:52.309090 17720 ts_tablet_manager.cc:1428] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 02:20:52.310642 17721 raft_consensus.cc:348] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:20:52.310894 17721 raft_consensus.cc:374] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:20:52.310954 17721 raft_consensus.cc:729] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b3e8c1e07784fcb9aa4a09f43d14784, State: Initialized, Role: FOLLOWER
I20260806 02:20:52.311383 17721 consensus_queue.cc:260] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:20:52.312059 17703 heartbeater.cc:503] Master 127.26.189.190:36853 was elected leader, sending a full tablet report...
I20260806 02:20:52.312381 17721 ts_tablet_manager.cc:1428] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
W20260806 02:20:52.482105 17704 tablet.cc:2369] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 02:20:52.519793 17524 tablet.cc:2369] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:20:52.632584 17725 raft_consensus.cc:482] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:20:52.632844 17725 raft_consensus.cc:504] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:20:52.634117 17725 leader_election.cc:288] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199), 7ca1a63f5be445bb82013fa3d1842e58 (127.26.189.129:38291)
I20260806 02:20:52.638190 17715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.634476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:56783 (local address 127.26.189.130:45199)
0806 02:20:52.634617 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:52.634622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:52.635061 (+ 439us) server_negotiation.cc:407] Connection header received
0806 02:20:52.635179 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:52.635182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:52.635234 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:52.635321 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:52.635586 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.636080 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.637180 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.637605 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.637738 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.637793 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:52.637979 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 02:20:52.638051 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 02:20:52.638234 17726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.634541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:49757 (local address 127.26.189.129:38291)
0806 02:20:52.634843 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:52.634850 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:52.634869 (+ 19us) server_negotiation.cc:407] Connection header received
0806 02:20:52.634929 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:52.634931 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:52.634987 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:52.635123 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:20:52.635426 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.635961 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.637127 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.637683 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.637817 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.637987 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:52.638026 (+ 39us) server_negotiation.cc:299] Negotiation successful
0806 02:20:52.638093 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":117,"threads_started":1}
I20260806 02:20:52.638233 17707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.634426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38291 (local address 127.26.189.131:49757)
0806 02:20:52.634589 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:52.634608 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:52.634742 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:52.635136 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:52.635139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:52.635158 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:52.635299 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:52.635305 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.636096 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.636099 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:52.636988 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:52.636998 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.637809 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.637813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:52.637915 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.637935 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 02:20:52.638004 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 02:20:52.638076 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72,"mutex_wait_us":72}
I20260806 02:20:52.638248 17728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.634429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:45199 (local address 127.26.189.131:56783)
0806 02:20:52.634956 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:52.634966 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 02:20:52.635080 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:20:52.635329 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:20:52.635332 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:20:52.635347 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:20:52.635464 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:52.635469 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.636195 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.636206 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:52.637049 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:20:52.637058 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.637736 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.637740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:20:52.637843 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.637872 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 02:20:52.637962 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 02:20:52.638033 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":175,"thread_start_us":131,"threads_started":1}
I20260806 02:20:52.638916 17444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0ae43dde5844b193d8892b3d61a6b8" candidate_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" is_pre_election: true
I20260806 02:20:52.638904 17278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0ae43dde5844b193d8892b3d61a6b8" candidate_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca1a63f5be445bb82013fa3d1842e58" is_pre_election: true
I20260806 02:20:52.639207 17278 raft_consensus.cc:2454] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b3e8c1e07784fcb9aa4a09f43d14784 in term 0.
I20260806 02:20:52.639240 17444 raft_consensus.cc:2454] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b3e8c1e07784fcb9aa4a09f43d14784 in term 0.
I20260806 02:20:52.639741 17552 leader_election.cc:302] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b3e8c1e07784fcb9aa4a09f43d14784, 7ca1a63f5be445bb82013fa3d1842e58; no voters:
I20260806 02:20:52.640039 17725 raft_consensus.cc:2781] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:20:52.640125 17725 raft_consensus.cc:482] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:20:52.640199 17725 raft_consensus.cc:3037] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:52.641469 17725 raft_consensus.cc:504] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:20:52.641930 17725 leader_election.cc:288] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [CANDIDATE]: Term 1 election: Requested vote from peers 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199), 7ca1a63f5be445bb82013fa3d1842e58 (127.26.189.129:38291)
I20260806 02:20:52.642261 17444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0ae43dde5844b193d8892b3d61a6b8" candidate_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b9e564a3ad04418ad3686c04d53cb6c"
I20260806 02:20:52.642398 17444 raft_consensus.cc:3037] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:52.642416 17278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff0ae43dde5844b193d8892b3d61a6b8" candidate_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca1a63f5be445bb82013fa3d1842e58"
I20260806 02:20:52.642556 17278 raft_consensus.cc:3037] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:20:52.643510 17444 raft_consensus.cc:2454] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b3e8c1e07784fcb9aa4a09f43d14784 in term 1.
I20260806 02:20:52.643579 17278 raft_consensus.cc:2454] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b3e8c1e07784fcb9aa4a09f43d14784 in term 1.
I20260806 02:20:52.643844 17555 leader_election.cc:302] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b3e8c1e07784fcb9aa4a09f43d14784, 5b9e564a3ad04418ad3686c04d53cb6c; no voters:
I20260806 02:20:52.644006 17725 raft_consensus.cc:2781] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:20:52.644244 17725 raft_consensus.cc:686] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 1 LEADER]: Becoming Leader. State: Replica: 1b3e8c1e07784fcb9aa4a09f43d14784, State: Running, Role: LEADER
I20260806 02:20:52.644583 17725 consensus_queue.cc:237] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:20:52.647535 17074 catalog_manager.cc:5495] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131). New cstate: current_term: 1 leader_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } health_report { overall_health: UNKNOWN } } }
I20260806 02:20:52.739460 17718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.735444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53496 (local address 127.26.189.131:45173)
0806 02:20:52.735602 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 02:20:52.735605 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:20:52.735620 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:20:52.735707 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:20:52.735709 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:20:52.735765 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:20:52.735862 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:20:52.736098 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.736636 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.737836 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:20:52.738120 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:20:52.738225 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:20:52.738563 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:20:52.739009 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:20:52.739153 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 02:20:52.739267 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 02:20:52.739325 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 02:20:52.745946 17444 raft_consensus.cc:1261] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c [term 1 FOLLOWER]: Refusing update from remote peer 1b3e8c1e07784fcb9aa4a09f43d14784: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:20:52.745971 17278 raft_consensus.cc:1261] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Refusing update from remote peer 1b3e8c1e07784fcb9aa4a09f43d14784: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:20:52.746743 17725 consensus_queue.cc:1035] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:20:52.746969 17729 consensus_queue.cc:1035] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:20:52.753317 17735 mvcc.cc:205] Tried to move back new op lower bound from 7315385764838998016 to 7315385764434731008. Current Snapshot: MvccSnapshot[applied={T|T < 7315385764838998016}]
I20260806 02:20:52.756115 17737 mvcc.cc:205] Tried to move back new op lower bound from 7315385764838998016 to 7315385764434731008. Current Snapshot: MvccSnapshot[applied={T|T < 7315385764838998016}]
I20260806 02:20:52.763370 17074 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:20:52.763564 17074 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:20:52.766197 17074 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Sending DeleteTablet for 3 replicas of tablet ff0ae43dde5844b193d8892b3d61a6b8
I20260806 02:20:52.767006 17249 tablet_service.cc:1514] Processing DeleteTablet for tablet ff0ae43dde5844b193d8892b3d61a6b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:52 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:50058
I20260806 02:20:52.767084 17410 tablet_service.cc:1514] Processing DeleteTablet for tablet ff0ae43dde5844b193d8892b3d61a6b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:52 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:49224
I20260806 02:20:52.767432 17748 tablet_replica.cc:330] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: stopping tablet replica
I20260806 02:20:52.767475 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 17129
I20260806 02:20:52.778668 17616 tablet_service.cc:1514] Processing DeleteTablet for tablet ff0ae43dde5844b193d8892b3d61a6b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:20:52 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:53484
I20260806 02:20:52.778831 17750 tablet_replica.cc:330] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c: stopping tablet replica
I20260806 02:20:52.779212 17750 raft_consensus.cc:2229] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:20:52.779425 17751 tablet_replica.cc:330] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784: stopping tablet replica
I20260806 02:20:52.779706 17750 raft_consensus.cc:2258] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:52.779839 17751 raft_consensus.cc:2229] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:20:52.780336 17751 raft_consensus.cc:2258] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:20:52.781597 17750 ts_tablet_manager.cc:1905] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:20:52.781893 17751 ts_tablet_manager.cc:1905] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:20:52.784698 17751 ts_tablet_manager.cc:1918] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:20:52.784709 17750 ts_tablet_manager.cc:1918] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:20:52.784818 17750 log.cc:1196] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/ff0ae43dde5844b193d8892b3d61a6b8
I20260806 02:20:52.784917 17751 log.cc:1196] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/ff0ae43dde5844b193d8892b3d61a6b8
I20260806 02:20:52.785229 17750 ts_tablet_manager.cc:1939] T ff0ae43dde5844b193d8892b3d61a6b8 P 5b9e564a3ad04418ad3686c04d53cb6c: Deleting consensus metadata
I20260806 02:20:52.786226 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 17344
W20260806 02:20:52.786541 17057 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:38291 (error 108)
I20260806 02:20:52.803326 17751 ts_tablet_manager.cc:1939] T ff0ae43dde5844b193d8892b3d61a6b8 P 1b3e8c1e07784fcb9aa4a09f43d14784: Deleting consensus metadata
I20260806 02:20:52.804780 17057 catalog_manager.cc:4841] TS 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173): tablet ff0ae43dde5844b193d8892b3d61a6b8 (table test-table [id=422e6a5ef22a4769b69b234768ac2e58]) successfully deleted
I20260806 02:20:52.805784 17753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.805250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:38291 (local address 127.0.0.1:50070)
0806 02:20:52.805505 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:52.805691 (+ 186us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":100,"threads_started":1}
W20260806 02:20:52.806041 17057 catalog_manager.cc:4584] TS 7ca1a63f5be445bb82013fa3d1842e58 (127.26.189.129:38291): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ff0ae43dde5844b193d8892b3d61a6b8: Network error: Client connection negotiation failed: client connection to 127.26.189.129:38291: connect: Connection refused (error 111)
I20260806 02:20:52.810448 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 17527
I20260806 02:20:52.811197 17753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:20:52.810757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:45199 (local address 127.0.0.1:49236)
0806 02:20:52.810962 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 02:20:52.811090 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.130:45199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260806 02:20:52.822958 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 17033
I20260806 02:21:12.836571 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:36853
--webserver_interface=127.26.189.190
--webserver_port=43915
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:36853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:12.952247 17754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:12.952590 17754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:12.952673 17754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:12.956837 17754 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 02:21:12.956928 17754 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 02:21:12.956956 17754 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 02:21:12.956990 17754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:12.957029 17754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:12.957077 17754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:12.957131 17754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:12.957171 17754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:12.962774 17754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:36853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:36853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=43915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:12.963930 17754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:12.965034 17754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:12.974200 17762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:12.974265 17754 server_base.cc:1034] running on GCE node
W20260806 02:21:12.974366 17764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:12.974433 17761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:12.975173 17754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:12.976331 17754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:12.977566 17754 hybrid_clock.cc:648] HybridClock initialized: now 1785982872977521 us; error 42 us; skew 500 ppm
Aug 06 02:21:12 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982872, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:12.984520 17754 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:21:12.985435 17754 webserver.cc:460] Webserver started at http://127.26.189.190:43915/ using document root <none> and password file <none>
I20260806 02:21:12.986057 17754 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:12.986128 17754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:12.990020 17754 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:21:12.992138 17773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:12.993505 17754 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:12.993723 17754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "4114891c70c24e0385d8d436ea5aded0"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "3b5c4eb086c399cd31776be7f90270ba"
server_key_iv: "e371964f5eb9ef2a0fca8e3fbed25680"
server_key_version: "encryptionkey@0"
I20260806 02:21:12.994381 17754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:13.016366 17754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:13.020041 17754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:13.020252 17754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:13.028986 17754 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:36853
I20260806 02:21:13.029322 17848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:36853 every 8 connection(s)
I20260806 02:21:13.030381 17754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:13.035121 17849 sys_catalog.cc:263] Verifying existing consensus state
I20260806 02:21:13.035224 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 17754
I20260806 02:21:13.035763 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:38291
--local_ip_for_outbound_sockets=127.26.189.129
--tserver_master_addrs=127.26.189.190:36853
--webserver_port=45255
--webserver_interface=127.26.189.129
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:21:13.037042 17849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Bootstrap starting.
I20260806 02:21:13.055987 17849 log.cc:824] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:13.068056 17849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 02:21:13.068503 17849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Bootstrap complete.
I20260806 02:21:13.072840 17849 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } }
I20260806 02:21:13.073262 17849 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4114891c70c24e0385d8d436ea5aded0, State: Initialized, Role: FOLLOWER
I20260806 02:21:13.073813 17849 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } }
I20260806 02:21:13.073967 17849 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:13.074065 17849 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:13.074198 17849 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 2 FOLLOWER]: Advancing to term 3
I20260806 02:21:13.076136 17849 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } }
I20260806 02:21:13.076481 17849 leader_election.cc:302] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4114891c70c24e0385d8d436ea5aded0; no voters:
I20260806 02:21:13.076848 17849 leader_election.cc:288] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 02:21:13.076947 17855 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 02:21:13.077155 17855 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [term 3 LEADER]: Becoming Leader. State: Replica: 4114891c70c24e0385d8d436ea5aded0, State: Running, Role: LEADER
I20260806 02:21:13.077515 17855 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } }
I20260806 02:21:13.078184 17849 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:13.079027 17856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "4114891c70c24e0385d8d436ea5aded0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } } }
I20260806 02:21:13.079164 17856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:13.079504 17857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4114891c70c24e0385d8d436ea5aded0. Latest consensus state: current_term: 3 leader_uuid: "4114891c70c24e0385d8d436ea5aded0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4114891c70c24e0385d8d436ea5aded0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 36853 } } }
I20260806 02:21:13.079665 17857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:13.080502 17865 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:13.086199 17865 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:13.087070 17865 catalog_manager.cc:1259] Loaded cluster ID: 876f9bd5b44048d4a0f678d7565b2403
I20260806 02:21:13.087144 17865 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:13.089730 17865 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:13.090454 17865 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Loaded TSK: 0
I20260806 02:21:13.090541 17865 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4114891c70c24e0385d8d436ea5aded0: Loaded TSK: 1
F20260806 02:21:13.091279 17865 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f992c9169ad google::LogMessage::Fail() at ??:0
@ 0x7f992c91988a google::LogMessage::SendToLog() at ??:0
@ 0x7f992c9164de google::LogMessage::Flush() at ??:0
@ 0x7f992c917a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f992f5da18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f992f5d2f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f99372817bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f993725b99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f993725c178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f993729ddf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f99372bc82b std::function<>::operator()() at ??:0
@ 0x7f993725bb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f993725cf3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9937259579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f993729d640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f992eb683d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f992eb68c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f992eb6a3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f992eb59512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f99301a16db start_thread at ??:0
@ 0x7f992b41461f clone at ??:0
W20260806 02:21:13.195960 17852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:13.196348 17852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:13.196420 17852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:13.202834 17852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:13.202934 17852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:13.203037 17852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:21:13.211442 17852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:38291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=45255
--tserver_master_addrs=127.26.189.190:36853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:13.212994 17852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:13.214447 17852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:13.226382 17913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:13.226382 17914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:13.226383 17916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:13.227164 17852 server_base.cc:1034] running on GCE node
I20260806 02:21:13.227594 17852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:13.228271 17852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:13.229468 17852 hybrid_clock.cc:648] HybridClock initialized: now 1785982873229439 us; error 48 us; skew 500 ppm
Aug 06 02:21:13 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982873, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:13.237758 17852 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:21:13.238790 17852 webserver.cc:460] Webserver started at http://127.26.189.129:45255/ using document root <none> and password file <none>
I20260806 02:21:13.239404 17852 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:13.239468 17852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:13.243765 17852 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 02:21:13.246261 17926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:13.247828 17852 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:21:13.247996 17852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "7ca1a63f5be445bb82013fa3d1842e58"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "09157d8a6b08be6cb02f9d40c6a1b121"
server_key_iv: "2c3ab789b0726c54297b5d8a54ef389b"
server_key_version: "encryptionkey@0"
I20260806 02:21:13.248636 17852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:13.280815 17852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:13.285367 17852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:13.285631 17852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:13.286455 17852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:13.288206 17935 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 02:21:13.294085 17852 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 02:21:13.294221 17852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260806 02:21:13.294333 17852 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 02:21:13.296914 17852 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 02:21:13.296998 17852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20260806 02:21:13.297307 17935 tablet_bootstrap.cc:492] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: Bootstrap starting.
I20260806 02:21:13.310387 17852 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:38291
I20260806 02:21:13.311538 17852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:21:13.317763 18072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:38291 every 8 connection(s)
I20260806 02:21:13.320827 17935 log.cc:824] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:13.321530 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 17852
I20260806 02:21:13.322221 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:45199
--local_ip_for_outbound_sockets=127.26.189.130
--tserver_master_addrs=127.26.189.190:36853
--webserver_port=46803
--webserver_interface=127.26.189.130
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:21:13.330411 17935 tablet_bootstrap.cc:492] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 02:21:13.330871 17935 tablet_bootstrap.cc:492] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: Bootstrap complete.
I20260806 02:21:13.332438 17935 ts_tablet_manager.cc:1397] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: Time spent bootstrapping tablet: real 0.035s user 0.019s sys 0.012s
I20260806 02:21:13.335892 17935 raft_consensus.cc:348] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:21:13.336442 17935 raft_consensus.cc:729] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca1a63f5be445bb82013fa3d1842e58, State: Initialized, Role: FOLLOWER
I20260806 02:21:13.337011 17935 consensus_queue.cc:260] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:21:13.338217 17935 ts_tablet_manager.cc:1428] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
W20260806 02:21:13.360148 18075 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:21:13.314010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:57203)
0806 02:21:13.314576 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:13.314636 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:13.315596 (+ 960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:13.359044 (+ 43448us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":174,"threads_started":1}
W20260806 02:21:13.360877 18073 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:36853 (0 consecutive failures): Network error: Failed to ping master at 127.26.189.190:36853: Client connection negotiation failed: client connection to 127.26.189.190:36853: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 02:21:13.361778 18075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:13.361415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:57299)
0806 02:21:13.361607 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:13.361697 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 02:21:13.362535 18075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:13.362272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:59927)
0806 02:21:13.362399 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:13.362465 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 02:21:13.362746 18073 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 02:21:13.466346 18077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:13.466601 18077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:13.466643 18077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:13.470714 18077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:13.470774 18077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:13.470832 18077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:21:13.475883 18077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:45199
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=46803
--tserver_master_addrs=127.26.189.190:36853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:13.476871 18077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:13.477938 18077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:13.488047 18093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:13.488026 18087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:13.488026 18089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:13.488315 18077 server_base.cc:1034] running on GCE node
I20260806 02:21:13.488816 18077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:13.489602 18077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:13.490811 18077 hybrid_clock.cc:648] HybridClock initialized: now 1785982873490793 us; error 27 us; skew 500 ppm
Aug 06 02:21:13 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982873, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:13.493762 18077 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:21:13.494632 18077 webserver.cc:460] Webserver started at http://127.26.189.130:46803/ using document root <none> and password file <none>
I20260806 02:21:13.495167 18077 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:13.495239 18077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:13.499121 18077 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 02:21:13.501235 18105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:13.502562 18077 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:13.502662 18077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "5b9e564a3ad04418ad3686c04d53cb6c"
format_stamp: "Formatted at 2026-08-06 02:20:30 on dist-test-slave-gkw7"
server_key: "5b2f2fca923e1bb2d200a61b89358bd7"
server_key_iv: "8ea243de0ce9af7bf9f5c6f43a839357"
server_key_version: "encryptionkey@0"
I20260806 02:21:13.503214 18077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:13.517256 18077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:13.520241 18077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:13.520458 18077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:13.521104 18077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:13.522068 18077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:13.522126 18077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:13.522235 18077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:13.522275 18077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:13.531992 18077 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:45199
I20260806 02:21:13.532025 18266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:45199 every 8 connection(s)
I20260806 02:21:13.533061 18077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:21:13.533840 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 18077
I20260806 02:21:13.534283 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:45173
--local_ip_for_outbound_sockets=127.26.189.131
--tserver_master_addrs=127.26.189.190:36853
--webserver_port=43013
--webserver_interface=127.26.189.131
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:21:13.537025 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:13.535351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:47659)
0806 02:21:13.536189 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:13.536321 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":117,"threads_started":1}
W20260806 02:21:13.537613 18267 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:36853 (0 consecutive failures): Network error: Failed to ping master at 127.26.189.190:36853: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
I20260806 02:21:13.538282 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:13.538051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:39473)
0806 02:21:13.538171 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:13.538221 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 02:21:13.538914 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:13.538695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:54471)
0806 02:21:13.538812 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:13.538863 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 02:21:13.539108 18267 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 02:21:13.649295 18272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:13.649629 18272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:13.649710 18272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:13.653844 18272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:13.653921 18272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:13.654006 18272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:21:13.659698 18272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:45173
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=43013
--tserver_master_addrs=127.26.189.190:36853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:13.660825 18272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:13.661988 18272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:13.672024 18284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:13.671979 18282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:13.671979 18281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:13.672295 18272 server_base.cc:1034] running on GCE node
I20260806 02:21:13.672749 18272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:13.673444 18272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:13.674665 18272 hybrid_clock.cc:648] HybridClock initialized: now 1785982873674643 us; error 31 us; skew 500 ppm
Aug 06 02:21:13 dist-test-slave-gkw7 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982873, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:13.677810 18272 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:21:13.678773 18272 webserver.cc:460] Webserver started at http://127.26.189.131:43013/ using document root <none> and password file <none>
I20260806 02:21:13.679406 18272 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:13.679515 18272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:13.683810 18272 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260806 02:21:13.686247 18291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:13.687645 18272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:21:13.687759 18272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "1b3e8c1e07784fcb9aa4a09f43d14784"
format_stamp: "Formatted at 2026-08-06 02:20:31 on dist-test-slave-gkw7"
server_key: "48620602c7d8a3933eff0cbdbd816205"
server_key_iv: "bf5096b5af48567ff7f0391224f5f967"
server_key_version: "encryptionkey@0"
I20260806 02:21:13.688269 18272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:13.698328 18272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:13.701046 18272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:13.701195 18272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:13.701783 18272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:13.702623 18272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:13.702672 18272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:13.702709 18272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:13.702724 18272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:13.711675 18272 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:45173
I20260806 02:21:13.711771 18458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:45173 every 8 connection(s)
I20260806 02:21:13.712837 18272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:21:13.716493 18461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:13.714967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:41077)
0806 02:21:13.715662 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:13.715773 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":141,"threads_started":1}
W20260806 02:21:13.717020 18459 heartbeater.cc:644] Failed to heartbeat to 127.26.189.190:36853 (0 consecutive failures): Network error: Failed to ping master at 127.26.189.190:36853: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
I20260806 02:21:13.717664 18461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:13.717331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:53825)
0806 02:21:13.717464 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:13.717519 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 02:21:13.718360 18461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:13.718129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:41805)
0806 02:21:13.718245 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:13.718307 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 02:21:13.718550 18459 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 02:21:13.722486 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 18272
I20260806 02:21:14.363931 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:14.363449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:41057)
0806 02:21:14.363764 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:14.363824 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":100,"threads_started":1}
I20260806 02:21:14.540165 18464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:14.539750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:47347)
0806 02:21:14.540002 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:14.540059 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":68,"threads_started":1}
I20260806 02:21:14.556133 18465 raft_consensus.cc:482] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:21:14.556387 18465 raft_consensus.cc:504] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:21:14.557700 18465 leader_election.cc:288] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199), 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173)
Aug 06 02:21:14 dist-test-slave-gkw7 krb5kdc[16300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982873, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.131@KRBTEST.COM
Aug 06 02:21:14 dist-test-slave-gkw7 krb5kdc[16300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982873, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.130@KRBTEST.COM
I20260806 02:21:14.573271 18469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:14.558463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:38515 (local address 127.26.189.130:45199)
0806 02:21:14.558764 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:14.558785 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:14.558818 (+ 33us) server_negotiation.cc:407] Connection header received
0806 02:21:14.559506 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:14.559514 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:14.559863 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:14.560120 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:14.561601 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:14.562709 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:14.564082 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:14.564592 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:14.564777 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:14.568321 (+ 3544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:14.568330 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:14.568348 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:14.568390 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:14.570311 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:14.571049 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:14.571060 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:14.571065 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:14.571187 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:14.571619 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:14.571621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:14.571622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:14.572062 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:14.572199 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:14.572796 (+ 597us) server_negotiation.cc:299] Negotiation successful
0806 02:21:14.573073 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":89,"threads_started":1}
I20260806 02:21:14.573267 18466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:14.557945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:45173 (local address 127.26.189.129:42249)
0806 02:21:14.558380 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:14.558396 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:14.558505 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:14.560531 (+ 2026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:14.560534 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:14.560858 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:14.561366 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:14.561381 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:14.563048 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:14.563050 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:14.563906 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:14.563917 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:14.564765 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:14.564770 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:14.565012 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:14.565821 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:21:14.565838 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:14.567632 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:14.570430 (+ 2798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:14.570438 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:14.570455 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:14.570892 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:14.571339 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:14.571341 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:14.571343 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:14.571477 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:14.572225 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:14.572228 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:14.572452 (+ 224us) client_negotiation.cc:769] Sending connection context
0806 02:21:14.572649 (+ 197us) client_negotiation.cc:240] Negotiation successful
0806 02:21:14.573025 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"mutex_wait_us":120,"spinlock_wait_cycles":3840,"thread_start_us":70,"threads_started":1}
I20260806 02:21:14.573348 18468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:14.558284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:42249 (local address 127.26.189.131:45173)
0806 02:21:14.558732 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:14.558751 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:14.558804 (+ 53us) server_negotiation.cc:407] Connection header received
0806 02:21:14.559513 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:14.559520 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:14.559869 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:14.560198 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:14.561609 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:14.562903 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:14.564047 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:14.564594 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:14.564803 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:14.567924 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:14.567930 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:14.567946 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:14.567981 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:14.570261 (+ 2280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:14.571026 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:14.571034 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:14.571040 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:14.571197 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:14.571585 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:14.571588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:14.571591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:14.572064 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:14.572246 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:14.572805 (+ 559us) server_negotiation.cc:299] Negotiation successful
0806 02:21:14.573131 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":89,"threads_started":1}
I20260806 02:21:14.573383 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:14.557872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:45199 (local address 127.26.189.129:38515)
0806 02:21:14.558257 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:14.558275 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:14.558397 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:14.560269 (+ 1872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:14.560276 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:14.560864 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:14.561367 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:14.561382 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:14.562885 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:14.562889 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:14.563910 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:14.563921 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:14.564740 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:14.564744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:14.565008 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:14.565830 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:21:14.565848 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:14.568069 (+ 2221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:14.570473 (+ 2404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:14.570479 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:14.570481 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:14.570900 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:14.571302 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:14.571306 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:14.571308 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:14.571488 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:14.572197 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:14.572205 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:14.572455 (+ 250us) client_negotiation.cc:769] Sending connection context
0806 02:21:14.572652 (+ 197us) client_negotiation.cc:240] Negotiation successful
0806 02:21:14.573128 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":284,"spinlock_wait_cycles":102528}
W20260806 02:21:14.576562 17928 leader_election.cc:341] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173): Not found: Tablet not found: ff0ae43dde5844b193d8892b3d61a6b8
W20260806 02:21:14.576901 17930 leader_election.cc:341] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199): Not found: Tablet not found: ff0ae43dde5844b193d8892b3d61a6b8
I20260806 02:21:14.577018 17930 leader_election.cc:302] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ca1a63f5be445bb82013fa3d1842e58; no voters: 1b3e8c1e07784fcb9aa4a09f43d14784, 5b9e564a3ad04418ad3686c04d53cb6c
I20260806 02:21:14.577365 18465 raft_consensus.cc:2726] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:21:14.719651 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:14.719165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:60005)
0806 02:21:14.719456 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:14.719519 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":83,"threads_started":1}
I20260806 02:21:15.365159 18471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:15.364702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:40599)
0806 02:21:15.364972 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:15.365027 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":92,"threads_started":1}
I20260806 02:21:15.541322 18472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:15.540921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:41737)
0806 02:21:15.541164 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:15.541220 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":74,"threads_started":1}
I20260806 02:21:15.720901 18474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:15.720459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:46799)
0806 02:21:15.720740 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:15.720800 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":80,"threads_started":1}
I20260806 02:21:16.158699 18477 raft_consensus.cc:482] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:21:16.158839 18477 raft_consensus.cc:504] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:21:16.159272 18477 leader_election.cc:288] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199), 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173)
W20260806 02:21:16.160288 17930 leader_election.cc:341] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199): Not found: Tablet not found: ff0ae43dde5844b193d8892b3d61a6b8
W20260806 02:21:16.160449 17928 leader_election.cc:341] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173): Not found: Tablet not found: ff0ae43dde5844b193d8892b3d61a6b8
I20260806 02:21:16.160542 17928 leader_election.cc:302] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ca1a63f5be445bb82013fa3d1842e58; no voters: 1b3e8c1e07784fcb9aa4a09f43d14784, 5b9e564a3ad04418ad3686c04d53cb6c
I20260806 02:21:16.160749 18477 raft_consensus.cc:2726] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:21:16.366722 18478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:16.366186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:35145)
0806 02:21:16.366521 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:16.366605 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":144,"threads_started":1}
I20260806 02:21:16.542557 18482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:16.542104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:59853)
0806 02:21:16.542388 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:16.542454 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":113,"threads_started":1}
I20260806 02:21:16.722263 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:16.721812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:51183)
0806 02:21:16.722102 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:16.722163 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":106,"threads_started":1}
I20260806 02:21:17.368098 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:17.367595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:52309)
0806 02:21:17.367920 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:17.367988 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":79,"threads_started":1}
I20260806 02:21:17.543812 18485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:17.543347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:60597)
0806 02:21:17.543631 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:17.543705 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":78,"threads_started":1}
I20260806 02:21:17.723567 18487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:17.723078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:41713)
0806 02:21:17.723381 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:17.723452 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":88,"threads_started":1}
I20260806 02:21:17.733783 18488 raft_consensus.cc:482] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:21:17.733946 18488 raft_consensus.cc:504] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:21:17.734419 18488 leader_election.cc:288] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199), 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173)
W20260806 02:21:17.735196 17928 leader_election.cc:341] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173): Not found: Tablet not found: ff0ae43dde5844b193d8892b3d61a6b8
W20260806 02:21:17.735296 17930 leader_election.cc:341] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199): Not found: Tablet not found: ff0ae43dde5844b193d8892b3d61a6b8
I20260806 02:21:17.735405 17930 leader_election.cc:302] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ca1a63f5be445bb82013fa3d1842e58; no voters: 1b3e8c1e07784fcb9aa4a09f43d14784, 5b9e564a3ad04418ad3686c04d53cb6c
I20260806 02:21:17.735546 18488 raft_consensus.cc:2726] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:21:18.369738 18489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:18.369149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:57677)
0806 02:21:18.369509 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:18.369634 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":117,"threads_started":1}
I20260806 02:21:18.545095 18490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:18.544619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:53213)
0806 02:21:18.544910 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:18.544981 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":74,"threads_started":1}
I20260806 02:21:18.724897 18493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:18.724431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:34189)
0806 02:21:18.724728 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:18.724792 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":91,"threads_started":1}
I20260806 02:21:19.371102 18494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:19.370654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:42379)
0806 02:21:19.370937 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:19.371000 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":83,"threads_started":1}
I20260806 02:21:19.546375 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:19.545945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:39863)
0806 02:21:19.546216 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:19.546277 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":105,"threads_started":1}
I20260806 02:21:19.726229 18496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:19.725805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:56925)
0806 02:21:19.726078 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:19.726132 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":95,"threads_started":1}
I20260806 02:21:20.372537 18497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:20.372006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:56755)
0806 02:21:20.372368 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:20.372434 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":185,"threads_started":1}
I20260806 02:21:20.547660 18498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:20.547196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:49729)
0806 02:21:20.547505 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:20.547567 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":79,"threads_started":1}
I20260806 02:21:20.670648 18499 raft_consensus.cc:482] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:21:20.670787 18499 raft_consensus.cc:504] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:21:20.671271 18499 leader_election.cc:288] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199), 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173)
W20260806 02:21:20.672032 17930 leader_election.cc:341] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199): Not found: Tablet not found: ff0ae43dde5844b193d8892b3d61a6b8
W20260806 02:21:20.672138 17928 leader_election.cc:341] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173): Not found: Tablet not found: ff0ae43dde5844b193d8892b3d61a6b8
I20260806 02:21:20.672245 17928 leader_election.cc:302] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ca1a63f5be445bb82013fa3d1842e58; no voters: 1b3e8c1e07784fcb9aa4a09f43d14784, 5b9e564a3ad04418ad3686c04d53cb6c
I20260806 02:21:20.672413 18499 raft_consensus.cc:2726] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:21:20.727516 18501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:20.727008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:35469)
0806 02:21:20.727351 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:20.727412 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":77,"threads_started":1}
I20260806 02:21:21.373987 18503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:21.373439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:40057)
0806 02:21:21.373817 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:21.373882 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":153,"threads_started":1}
I20260806 02:21:21.549111 18504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:21.548602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:39527)
0806 02:21:21.548933 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:21.549003 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":84,"threads_started":1}
I20260806 02:21:21.728953 18506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:21.728467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:47299)
0806 02:21:21.728781 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:21.728852 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":139,"threads_started":1}
I20260806 02:21:22.375279 18507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:22.374825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:39607)
0806 02:21:22.375096 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:22.375160 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":76,"threads_started":1}
I20260806 02:21:22.550518 18508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:22.550057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:39619)
0806 02:21:22.550358 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:22.550417 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":115,"threads_started":1}
I20260806 02:21:22.730284 18509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:22.729849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:48401)
0806 02:21:22.730118 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:22.730177 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":83,"threads_started":1}
I20260806 02:21:23.376802 18511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:23.376314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:45085)
0806 02:21:23.376600 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:23.376687 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":106,"threads_started":1}
I20260806 02:21:23.551936 18512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:23.551425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:60745)
0806 02:21:23.551758 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:23.551829 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":104,"threads_started":1}
I20260806 02:21:23.731457 18514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:23.731034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:45653)
0806 02:21:23.731308 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:23.731361 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":94,"threads_started":1}
I20260806 02:21:24.378124 18515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:24.377665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:48097)
0806 02:21:24.377955 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:24.378015 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":86,"threads_started":1}
I20260806 02:21:24.553303 18516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:24.552793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:45277)
0806 02:21:24.553127 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:24.553193 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":82,"threads_started":1}
I20260806 02:21:24.732827 18518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:24.732369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:53737)
0806 02:21:24.732663 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:24.732722 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":98,"threads_started":1}
I20260806 02:21:25.379513 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:25.379030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:37267)
0806 02:21:25.379350 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:25.379409 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":91,"threads_started":1}
I20260806 02:21:25.554623 18522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:25.554121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:51237)
0806 02:21:25.554460 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:25.554523 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":100,"threads_started":1}
I20260806 02:21:25.734145 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:25.733695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:46623)
0806 02:21:25.733978 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:25.734041 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":78,"threads_started":1}
I20260806 02:21:26.104266 18524 raft_consensus.cc:482] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:21:26.104423 18524 raft_consensus.cc:504] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b9e564a3ad04418ad3686c04d53cb6c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45199 } } peers { permanent_uuid: "1b3e8c1e07784fcb9aa4a09f43d14784" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45173 } } peers { permanent_uuid: "7ca1a63f5be445bb82013fa3d1842e58" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 38291 } }
I20260806 02:21:26.104913 18524 leader_election.cc:288] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199), 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173)
W20260806 02:21:26.105895 17930 leader_election.cc:341] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5b9e564a3ad04418ad3686c04d53cb6c (127.26.189.130:45199): Not found: Tablet not found: ff0ae43dde5844b193d8892b3d61a6b8
W20260806 02:21:26.106006 17928 leader_election.cc:341] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1b3e8c1e07784fcb9aa4a09f43d14784 (127.26.189.131:45173): Not found: Tablet not found: ff0ae43dde5844b193d8892b3d61a6b8
I20260806 02:21:26.106072 17928 leader_election.cc:302] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ca1a63f5be445bb82013fa3d1842e58; no voters: 1b3e8c1e07784fcb9aa4a09f43d14784, 5b9e564a3ad04418ad3686c04d53cb6c
I20260806 02:21:26.106211 18524 raft_consensus.cc:2726] T ff0ae43dde5844b193d8892b3d61a6b8 P 7ca1a63f5be445bb82013fa3d1842e58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 02:21:26.380885 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:26.380444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:39081)
0806 02:21:26.380719 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:26.380782 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":88,"threads_started":1}
I20260806 02:21:26.555912 18526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:26.555446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:46417)
0806 02:21:26.555746 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:26.555811 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":84,"threads_started":1}
I20260806 02:21:26.735400 18527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:26.734958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:33213)
0806 02:21:26.735230 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:26.735301 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":96,"threads_started":1}
I20260806 02:21:27.382503 18528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:27.381966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:40697)
0806 02:21:27.382279 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:27.382360 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":81,"threads_started":1}
I20260806 02:21:27.557322 18529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:27.556812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:48695)
0806 02:21:27.557114 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:27.557215 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":85,"threads_started":1}
I20260806 02:21:27.736532 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:27.736105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:58687)
0806 02:21:27.736378 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:27.736433 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":105,"threads_started":1}
I20260806 02:21:28.383999 18532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:28.383559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.129:47429)
0806 02:21:28.383845 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:28.383900 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":107,"threads_started":1}
I20260806 02:21:28.558911 18534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:28.558347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.130:34919)
0806 02:21:28.558717 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:28.558797 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":104,"threads_started":1}
I20260806 02:21:28.725164 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 17852
I20260806 02:21:28.735502 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 18077
I20260806 02:21:28.738730 18535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:28.738043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:36853 (local address 127.26.189.131:39549)
0806 02:21:28.738501 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:28.738582 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.190:36853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":88,"threads_started":1}
I20260806 02:21:28.745142 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 18272
2026-08-06T02:21:28Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (60062 ms)
[----------] 30 tests from SecurityITest (253831 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:28 dist-test-slave-gkw7 krb5kdc[18539](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:28 dist-test-slave-gkw7 krb5kdc[18539](info): set up 2 sockets
Aug 06 02:21:28 dist-test-slave-gkw7 krb5kdc[18539](info): commencing operation
krb5kdc: starting...
W20260806 02:21:29.981604 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:30 dist-test-slave-gkw7 krb5kdc[18539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:21:30.117626 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:37451
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:37451
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:30.234655 18556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:30.234907 18556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:30.234947 18556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:30.238806 18556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:30.238860 18556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:30.238879 18556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:30.238896 18556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:30.238911 18556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:30.244171 18556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:37451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:37451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:30.245169 18556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:30.246198 18556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:30.254760 18564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:30.254760 18568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:30.255015 18556 server_base.cc:1034] running on GCE node
W20260806 02:21:30.254855 18562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:30.255736 18556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:30.256888 18556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:30.258088 18556 hybrid_clock.cc:648] HybridClock initialized: now 1785982890258050 us; error 60 us; skew 500 ppm
Aug 06 02:21:30 dist-test-slave-gkw7 krb5kdc[18539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982890, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:30.260866 18556 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:21:30.261804 18556 webserver.cc:460] Webserver started at http://127.26.189.190:42255/ using document root <none> and password file <none>
I20260806 02:21:30.262370 18556 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:30.262461 18556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:30.262686 18556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:30.264732 18556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "d7ed3aa3038f4909ad832a70304ec0d0"
format_stamp: "Formatted at 2026-08-06 02:21:30 on dist-test-slave-gkw7"
server_key: "37da8534da53bba10178f32bae6b8bbe"
server_key_iv: "c56f08a16b437208920b525baf4c3542"
server_key_version: "encryptionkey@0"
I20260806 02:21:30.265317 18556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "d7ed3aa3038f4909ad832a70304ec0d0"
format_stamp: "Formatted at 2026-08-06 02:21:30 on dist-test-slave-gkw7"
server_key: "37da8534da53bba10178f32bae6b8bbe"
server_key_iv: "c56f08a16b437208920b525baf4c3542"
server_key_version: "encryptionkey@0"
I20260806 02:21:30.268963 18556 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:21:30.271404 18579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:30.272662 18556 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:30.272792 18556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "d7ed3aa3038f4909ad832a70304ec0d0"
format_stamp: "Formatted at 2026-08-06 02:21:30 on dist-test-slave-gkw7"
server_key: "37da8534da53bba10178f32bae6b8bbe"
server_key_iv: "c56f08a16b437208920b525baf4c3542"
server_key_version: "encryptionkey@0"
I20260806 02:21:30.272899 18556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:30.286044 18556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:30.288851 18556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:30.289043 18556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:30.296124 18556 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:37451
I20260806 02:21:30.296240 18652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:37451 every 8 connection(s)
I20260806 02:21:30.297044 18556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:30.299836 18653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:30.305100 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 18556
I20260806 02:21:30.305261 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:30.305265 18653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0: Bootstrap starting.
I20260806 02:21:30.305559 27382 external_mini_cluster.cc:1428] Setting key 1df0af1ef079918b2b52d9018441a194
I20260806 02:21:30.307982 18653 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:30.308854 18653 log.cc:824] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:30.311137 18653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0: No bootstrap required, opened a new log
Aug 06 02:21:30 dist-test-slave-gkw7 krb5kdc[18539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:21:30.315205 18653 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7ed3aa3038f4909ad832a70304ec0d0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37451 } }
I20260806 02:21:30.315482 18653 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:30.315551 18653 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ed3aa3038f4909ad832a70304ec0d0, State: Initialized, Role: FOLLOWER
I20260806 02:21:30.315996 18653 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7ed3aa3038f4909ad832a70304ec0d0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37451 } }
I20260806 02:21:30.316120 18653 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:30.316162 18653 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:30.316226 18653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:30.317041 18653 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7ed3aa3038f4909ad832a70304ec0d0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37451 } }
I20260806 02:21:30.317368 18653 leader_election.cc:302] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7ed3aa3038f4909ad832a70304ec0d0; no voters:
I20260806 02:21:30.317710 18653 leader_election.cc:288] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:30.317785 18660 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:30.317991 18660 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [term 1 LEADER]: Becoming Leader. State: Replica: d7ed3aa3038f4909ad832a70304ec0d0, State: Running, Role: LEADER
I20260806 02:21:30.318356 18660 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7ed3aa3038f4909ad832a70304ec0d0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37451 } }
I20260806 02:21:30.319006 18653 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:30.320499 18662 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7ed3aa3038f4909ad832a70304ec0d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7ed3aa3038f4909ad832a70304ec0d0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37451 } } }
I20260806 02:21:30.321102 18662 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:30.321110 18656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:30.306890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55816 (local address 127.26.189.190:37451)
0806 02:21:30.307311 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:30.307331 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:30.307372 (+ 41us) server_negotiation.cc:407] Connection header received
0806 02:21:30.308275 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:30.308299 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:30.308697 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:30.309065 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:30.309943 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:30.311392 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:30.312226 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:30.312962 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:30.313136 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:30.315817 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:30.315824 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:30.315842 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:30.315872 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:30.317808 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:30.318382 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:30.318387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:30.318392 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:30.318528 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:30.318815 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:30.318820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:30.318822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:30.319272 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:30.319479 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:30.319723 (+ 244us) server_negotiation.cc:299] Negotiation successful
0806 02:21:30.320057 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":108,"threads_started":1}
I20260806 02:21:30.320996 18661 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7ed3aa3038f4909ad832a70304ec0d0. Latest consensus state: current_term: 1 leader_uuid: "d7ed3aa3038f4909ad832a70304ec0d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7ed3aa3038f4909ad832a70304ec0d0" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 37451 } } }
I20260806 02:21:30.321396 18661 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0 [sys.catalog]: This master's current role is: LEADER
W20260806 02:21:30.324232 18679 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:21:30.324316 18679 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:21:30.324396 18678 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:30.325083 18678 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:30.330173 18678 catalog_manager.cc:1347] Generated new cluster ID: 38c222d13f6b4c16a6a102b2b1e434d1
I20260806 02:21:30.330240 18678 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:30.387333 18678 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:30.388419 18678 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:30.395617 18678 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0: Generated new TSK 0
I20260806 02:21:30.396478 18678 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:21:30.438846 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37451
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:30.564463 18685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:30.564764 18685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:30.564810 18685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:30.569054 18685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:30.569133 18685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:30.569260 18685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:21:30.574780 18685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:30.576118 18685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:30.577313 18685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:30.587334 18696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:30.587347 18695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:30.587334 18698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:30.587711 18685 server_base.cc:1034] running on GCE node
I20260806 02:21:30.588176 18685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:30.588810 18685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:30.589993 18685 hybrid_clock.cc:648] HybridClock initialized: now 1785982890589962 us; error 46 us; skew 500 ppm
Aug 06 02:21:30 dist-test-slave-gkw7 krb5kdc[18539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982890, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:30.592836 18685 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:21:30.593775 18685 webserver.cc:460] Webserver started at http://127.26.189.129:46215/ using document root <none> and password file <none>
I20260806 02:21:30.594354 18685 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:30.594444 18685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:30.594678 18685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:30.596730 18685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0"
format_stamp: "Formatted at 2026-08-06 02:21:30 on dist-test-slave-gkw7"
server_key: "955dbc20b705722672bfe43416ba3c20"
server_key_iv: "5ef388b00cbfb7c923e9aa2ce1c27c35"
server_key_version: "encryptionkey@0"
I20260806 02:21:30.597329 18685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0"
format_stamp: "Formatted at 2026-08-06 02:21:30 on dist-test-slave-gkw7"
server_key: "955dbc20b705722672bfe43416ba3c20"
server_key_iv: "5ef388b00cbfb7c923e9aa2ce1c27c35"
server_key_version: "encryptionkey@0"
I20260806 02:21:30.601238 18685 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260806 02:21:30.603962 18706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:30.605269 18685 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 02:21:30.605415 18685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0"
format_stamp: "Formatted at 2026-08-06 02:21:30 on dist-test-slave-gkw7"
server_key: "955dbc20b705722672bfe43416ba3c20"
server_key_iv: "5ef388b00cbfb7c923e9aa2ce1c27c35"
server_key_version: "encryptionkey@0"
I20260806 02:21:30.605535 18685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:30.638173 18685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:30.641294 18685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:30.641510 18685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:30.642194 18685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:30.643072 18685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:30.643141 18685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:30.643209 18685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:30.643253 18685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:30.652279 18685 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:39321
I20260806 02:21:30.652313 18864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:39321 every 8 connection(s)
I20260806 02:21:30.653163 18685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:21:30.657212 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 18685
I20260806 02:21:30.657372 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:21:30.657732 27382 external_mini_cluster.cc:1428] Setting key bf77960a9d2f580c5895ce1e3c90160a
Aug 06 02:21:30 dist-test-slave-gkw7 krb5kdc[18539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982890, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:21:30.667516 18656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:30.654982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:38233 (local address 127.26.189.190:37451)
0806 02:21:30.655121 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:30.655126 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:30.655920 (+ 794us) server_negotiation.cc:407] Connection header received
0806 02:21:30.657280 (+ 1360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:30.657284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:30.657343 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:30.657428 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:30.658770 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:30.659405 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:30.660551 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:30.660794 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:30.660906 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:30.663856 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:30.663859 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:30.663861 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:30.663886 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:30.665366 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:30.665929 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:30.665934 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:30.665936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:30.666020 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:30.666368 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:30.666371 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:30.666373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:30.666558 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:30.666664 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:30.667192 (+ 528us) server_negotiation.cc:299] Negotiation successful
0806 02:21:30.667337 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
I20260806 02:21:30.668354 18869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:30.655331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37451 (local address 127.26.189.129:38233)
0806 02:21:30.655771 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:30.655815 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:30.657059 (+ 1244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:30.657639 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:30.657646 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:30.658040 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:30.658617 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:30.658631 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:30.659534 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:30.659538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:30.660426 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:30.660435 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:30.660948 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:30.660952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:30.661189 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:30.661929 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:21:30.661952 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:30.663672 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:30.665496 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:30.665503 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:30.665519 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:30.665823 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:30.666114 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:30.666118 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:30.666120 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:30.666266 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:30.666665 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:30.666672 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:30.666940 (+ 268us) client_negotiation.cc:769] Sending connection context
0806 02:21:30.667131 (+ 191us) client_negotiation.cc:240] Negotiation successful
0806 02:21:30.667477 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":112,"threads_started":1}
I20260806 02:21:30.669726 18865 heartbeater.cc:347] Connected to a master server at 127.26.189.190:37451
I20260806 02:21:30.670046 18865 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:30.670572 18865 heartbeater.cc:511] Master 127.26.189.190:37451 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:21:30.672113 18602 ts_manager.cc:194] Registered new tserver with Master: 5688dfbf17ba483ca8ec5c3b0866d1e0 (127.26.189.129:39321)
I20260806 02:21:30.673400 18602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:38233
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:21:30.688545 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37451
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:30.804755 18872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:30.805069 18872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:30.805143 18872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:30.809206 18872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:30.809266 18872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:30.809324 18872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:21:30.814702 18872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:30.815747 18872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:30.816741 18872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:30.826699 18882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:30.826741 18886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:30.826714 18879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:30.827059 18872 server_base.cc:1034] running on GCE node
I20260806 02:21:30.827522 18872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:30.828168 18872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:30.829377 18872 hybrid_clock.cc:648] HybridClock initialized: now 1785982890829361 us; error 28 us; skew 500 ppm
Aug 06 02:21:30 dist-test-slave-gkw7 krb5kdc[18539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982890, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:30.832257 18872 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:21:30.833112 18872 webserver.cc:460] Webserver started at http://127.26.189.130:45061/ using document root <none> and password file <none>
I20260806 02:21:30.833727 18872 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:30.833828 18872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:30.834052 18872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:30.836126 18872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "8a43cb97955e456f8ed57f470ec00326"
format_stamp: "Formatted at 2026-08-06 02:21:30 on dist-test-slave-gkw7"
server_key: "2e77e3a8f03f87126f89dc15c0b6d968"
server_key_iv: "a4789bbbb5acb336611fe0797b0fb922"
server_key_version: "encryptionkey@0"
I20260806 02:21:30.836680 18872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "8a43cb97955e456f8ed57f470ec00326"
format_stamp: "Formatted at 2026-08-06 02:21:30 on dist-test-slave-gkw7"
server_key: "2e77e3a8f03f87126f89dc15c0b6d968"
server_key_iv: "a4789bbbb5acb336611fe0797b0fb922"
server_key_version: "encryptionkey@0"
I20260806 02:21:30.840368 18872 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 02:21:30.842813 18895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:30.844004 18872 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 02:21:30.844132 18872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "8a43cb97955e456f8ed57f470ec00326"
format_stamp: "Formatted at 2026-08-06 02:21:30 on dist-test-slave-gkw7"
server_key: "2e77e3a8f03f87126f89dc15c0b6d968"
server_key_iv: "a4789bbbb5acb336611fe0797b0fb922"
server_key_version: "encryptionkey@0"
I20260806 02:21:30.844238 18872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:30.858130 18872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:30.861284 18872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:30.861475 18872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:30.862087 18872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:30.862908 18872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:30.862977 18872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:30.863044 18872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:30.863087 18872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:30.871847 18872 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:42551
I20260806 02:21:30.871903 19065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:42551 every 8 connection(s)
I20260806 02:21:30.872756 18872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:21:30.876255 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 18872
I20260806 02:21:30.876395 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:21:30.876685 27382 external_mini_cluster.cc:1428] Setting key 045dc982da15ad3845a3f63fea9cf342
Aug 06 02:21:30 dist-test-slave-gkw7 krb5kdc[18539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982890, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
I20260806 02:21:30.887331 18656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:30.874572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:52849 (local address 127.26.189.190:37451)
0806 02:21:30.874719 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:30.874723 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:30.875510 (+ 787us) server_negotiation.cc:407] Connection header received
0806 02:21:30.877049 (+ 1539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:30.877053 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:30.877114 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:30.877227 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:30.878651 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:30.879176 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:30.880510 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:30.880727 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:30.880814 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:30.883764 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:30.883767 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:30.883769 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:30.883792 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:30.885202 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:30.885800 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:30.885804 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:30.885806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:30.885885 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:30.886222 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:30.886226 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:30.886227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:30.886416 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:30.886522 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:30.887024 (+ 502us) server_negotiation.cc:299] Negotiation successful
0806 02:21:30.887145 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 02:21:30.888172 19069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:30.874930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37451 (local address 127.26.189.130:52849)
0806 02:21:30.875360 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:30.875401 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:30.876813 (+ 1412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:30.877466 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:30.877475 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:30.878017 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:30.878505 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:30.878519 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:30.879301 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:30.879304 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:30.880382 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:30.880396 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:30.880886 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:30.880892 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:30.881119 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:30.881819 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:21:30.881845 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:30.883591 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:30.885330 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:30.885336 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:30.885352 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:30.885682 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:30.885975 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:30.885979 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:30.885981 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:30.886124 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:30.886521 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:30.886528 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:30.886786 (+ 258us) client_negotiation.cc:769] Sending connection context
0806 02:21:30.886968 (+ 182us) client_negotiation.cc:240] Negotiation successful
0806 02:21:30.887298 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":118,"threads_started":1}
I20260806 02:21:30.889392 19066 heartbeater.cc:347] Connected to a master server at 127.26.189.190:37451
I20260806 02:21:30.889707 19066 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
I20260806 02:21:30.890305 19066 heartbeater.cc:511] Master 127.26.189.190:37451 requested a full tablet report, sending...
I20260806 02:21:30.891410 18602 ts_manager.cc:194] Registered new tserver with Master: 8a43cb97955e456f8ed57f470ec00326 (127.26.189.130:42551)
I20260806 02:21:30.892155 18602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:52849
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:21:30.909130 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37451
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:37341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:31.025933 19074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:31.026209 19074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:31.026255 19074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:31.030231 19074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:31.030292 19074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:31.030350 19074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:21:31.035704 19074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:37341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:37451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:31.036744 19074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:31.037788 19074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:31.047844 19082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:31.047814 19081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:31.047814 19086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:31.048503 19074 server_base.cc:1034] running on GCE node
I20260806 02:21:31.048935 19074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:31.049677 19074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:31.050861 19074 hybrid_clock.cc:648] HybridClock initialized: now 1785982891050824 us; error 46 us; skew 500 ppm
Aug 06 02:21:31 dist-test-slave-gkw7 krb5kdc[18539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982891, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:31.053932 19074 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:21:31.054872 19074 webserver.cc:460] Webserver started at http://127.26.189.131:35781/ using document root <none> and password file <none>
I20260806 02:21:31.055444 19074 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:31.055507 19074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:31.055765 19074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:31.057988 19074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "c8e2acc12e454c34b05ae2423cc9808a"
format_stamp: "Formatted at 2026-08-06 02:21:31 on dist-test-slave-gkw7"
server_key: "6584372b062951cacfefe2f31c608902"
server_key_iv: "a38481d3090b35e6536ffccef45453da"
server_key_version: "encryptionkey@0"
I20260806 02:21:31.058575 19074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "c8e2acc12e454c34b05ae2423cc9808a"
format_stamp: "Formatted at 2026-08-06 02:21:31 on dist-test-slave-gkw7"
server_key: "6584372b062951cacfefe2f31c608902"
server_key_iv: "a38481d3090b35e6536ffccef45453da"
server_key_version: "encryptionkey@0"
I20260806 02:21:31.062577 19074 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 02:21:31.065325 19094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:31.066768 19074 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:21:31.066920 19074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "c8e2acc12e454c34b05ae2423cc9808a"
format_stamp: "Formatted at 2026-08-06 02:21:31 on dist-test-slave-gkw7"
server_key: "6584372b062951cacfefe2f31c608902"
server_key_iv: "a38481d3090b35e6536ffccef45453da"
server_key_version: "encryptionkey@0"
I20260806 02:21:31.067047 19074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:31.089105 19074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:31.092331 19074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:31.092545 19074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:31.093207 19074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:31.094139 19074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:31.094208 19074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:31.094277 19074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:31.094324 19074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:31.103737 19074 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:45579
I20260806 02:21:31.103801 19250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:45579 every 8 connection(s)
I20260806 02:21:31.104756 19074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:21:31.106815 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 19074
I20260806 02:21:31.106987 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:21:31.107314 27382 external_mini_cluster.cc:1428] Setting key 4fae1d012c037be0e5c5c8d9364aa328
Aug 06 02:21:31 dist-test-slave-gkw7 krb5kdc[18539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982891, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:21:31.119378 18656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.106781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:38583 (local address 127.26.189.190:37451)
0806 02:21:31.106968 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:31.106974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:31.107966 (+ 992us) server_negotiation.cc:407] Connection header received
0806 02:21:31.109467 (+ 1501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:31.109470 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:31.109567 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:31.109669 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:31.110877 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.111530 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.112730 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.112949 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.113028 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.115673 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:31.115677 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:31.115679 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:31.115703 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:31.117190 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:31.117839 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:31.117842 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:31.117844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:31.117923 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:31.118284 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:31.118286 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:31.118287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:31.118458 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:31.118535 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:31.119134 (+ 599us) server_negotiation.cc:299] Negotiation successful
0806 02:21:31.119250 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 02:21:31.120481 19253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.107260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:37451 (local address 127.26.189.131:38583)
0806 02:21:31.107804 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:31.107861 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:31.109263 (+ 1402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:31.109840 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:31.109847 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:31.110211 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:31.110714 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.110728 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.111667 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.111670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.112598 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.112607 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.113083 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.113086 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.113227 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.113820 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:21:31.113838 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:31.115485 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:31.117308 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:31.117314 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:31.117327 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:31.117725 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:31.118010 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:31.118012 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:31.118014 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:31.118199 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:31.118548 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:31.118554 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:31.118816 (+ 262us) client_negotiation.cc:769] Sending connection context
0806 02:21:31.119082 (+ 266us) client_negotiation.cc:240] Negotiation successful
0806 02:21:31.119408 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":156,"threads_started":1}
I20260806 02:21:31.121742 19251 heartbeater.cc:347] Connected to a master server at 127.26.189.190:37451
I20260806 02:21:31.122006 19251 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:31.122512 19251 heartbeater.cc:511] Master 127.26.189.190:37451 requested a full tablet report, sending...
I20260806 02:21:31.123617 18602 ts_manager.cc:194] Registered new tserver with Master: c8e2acc12e454c34b05ae2423cc9808a (127.26.189.131:45579)
I20260806 02:21:31.124215 18602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:38583
I20260806 02:21:31.133631 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:21:31.143615 18656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.135735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55822 (local address 127.26.189.190:37451)
0806 02:21:31.135886 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:31.135891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:31.136087 (+ 196us) server_negotiation.cc:407] Connection header received
0806 02:21:31.136225 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:31.136228 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:31.136280 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:31.136372 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:31.137093 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.137746 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.138614 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.138844 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.138953 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.140353 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:31.140357 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:31.140360 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:31.140385 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:31.141923 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:31.142350 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:31.142354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:31.142356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:31.142438 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:31.142714 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:31.142718 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:31.142720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:31.142945 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:31.143085 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:31.143327 (+ 242us) server_negotiation.cc:299] Negotiation successful
0806 02:21:31.143447 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 02:21:31.146546 18602 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55822:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:21:31.149814 18602 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:21:31.165270 19267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.159644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56562 (local address 127.26.189.131:45579)
0806 02:21:31.160175 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:31.160189 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:31.160213 (+ 24us) server_negotiation.cc:407] Connection header received
0806 02:21:31.160295 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:31.160302 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:31.160502 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:31.160904 (+ 402us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:31.161036 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.161922 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.163604 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.164409 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.164649 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.164797 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:31.164955 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 02:21:31.165068 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":180,"threads_started":1}
I20260806 02:21:31.165357 19264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.158901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:45579 (local address 127.0.0.1:56562)
0806 02:21:31.159565 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:31.159583 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:31.159703 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:31.160670 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:31.160673 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:31.160686 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:31.160758 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.160763 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.162045 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.162052 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.163469 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.163480 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.164619 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.164622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.164750 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.164788 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 02:21:31.164909 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 02:21:31.165034 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":24,"thread_start_us":112,"threads_started":1}
I20260806 02:21:31.165656 19265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.158832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43616 (local address 127.26.189.130:42551)
0806 02:21:31.159990 (+ 1158us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:31.160005 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:31.160032 (+ 27us) server_negotiation.cc:407] Connection header received
0806 02:21:31.160119 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:31.160126 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:31.160365 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:31.160553 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:31.160887 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.162270 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.163701 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.164428 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.164547 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.164816 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:31.165328 (+ 512us) server_negotiation.cc:299] Negotiation successful
0806 02:21:31.165447 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1037,"thread_start_us":188,"threads_started":1}
I20260806 02:21:31.165741 19266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.159505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:39321 (local address 127.0.0.1:59962)
0806 02:21:31.159799 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:31.159829 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:31.159924 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:31.161049 (+ 1125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:31.161052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:31.161072 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:31.161171 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.161177 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.162754 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.162758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.163943 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.163954 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.165254 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.165258 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.165376 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.165415 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 02:21:31.165484 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 02:21:31.165608 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":110,"threads_started":1}
I20260806 02:21:31.165830 19263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.158625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:42551 (local address 127.0.0.1:43616)
0806 02:21:31.159048 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:31.159102 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:31.159227 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:31.160552 (+ 1325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:31.160562 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:31.160591 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:31.160752 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.160759 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.162421 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.162425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.163573 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.163583 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.164884 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.164890 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.164975 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.164995 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 02:21:31.165062 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 02:21:31.165114 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":18,"thread_start_us":147,"threads_started":1}
I20260806 02:21:31.167130 19269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.160101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59962 (local address 127.26.189.129:39321)
0806 02:21:31.160568 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:31.160584 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:31.160609 (+ 25us) server_negotiation.cc:407] Connection header received
0806 02:21:31.160689 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:31.160694 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:31.160896 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:31.161070 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:31.161292 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.162575 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.164082 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.165088 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.166066 (+ 978us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.166767 (+ 701us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:31.166824 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 02:21:31.166925 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":103,"threads_started":1}
I20260806 02:21:31.169476 19164 tablet_service.cc:1467] Processing CreateTablet for tablet cba0745c03ff4fc5b652183967021b98 (DEFAULT_TABLE table=test-table [id=3b9daa8da55241fbaef3b20ef7af712e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:31.170599 19164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cba0745c03ff4fc5b652183967021b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:31.170356 18768 tablet_service.cc:1467] Processing CreateTablet for tablet cba0745c03ff4fc5b652183967021b98 (DEFAULT_TABLE table=test-table [id=3b9daa8da55241fbaef3b20ef7af712e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:31.171506 18768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cba0745c03ff4fc5b652183967021b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:31.171648 18970 tablet_service.cc:1467] Processing CreateTablet for tablet cba0745c03ff4fc5b652183967021b98 (DEFAULT_TABLE table=test-table [id=3b9daa8da55241fbaef3b20ef7af712e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:31.172704 18970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cba0745c03ff4fc5b652183967021b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:31.177661 19270 tablet_bootstrap.cc:492] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a: Bootstrap starting.
I20260806 02:21:31.179837 19270 tablet_bootstrap.cc:654] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:31.179986 19272 tablet_bootstrap.cc:492] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0: Bootstrap starting.
I20260806 02:21:31.180835 19273 tablet_bootstrap.cc:492] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326: Bootstrap starting.
I20260806 02:21:31.181627 19270 log.cc:824] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:31.182426 19272 tablet_bootstrap.cc:654] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:31.183044 19273 tablet_bootstrap.cc:654] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:31.183347 19272 log.cc:824] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:31.184202 19270 tablet_bootstrap.cc:492] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a: No bootstrap required, opened a new log
I20260806 02:21:31.184372 19273 log.cc:824] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:31.184422 19270 ts_tablet_manager.cc:1397] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 02:21:31.185563 19272 tablet_bootstrap.cc:492] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0: No bootstrap required, opened a new log
I20260806 02:21:31.185758 19272 ts_tablet_manager.cc:1397] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:21:31.186209 19273 tablet_bootstrap.cc:492] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326: No bootstrap required, opened a new log
I20260806 02:21:31.186404 19273 ts_tablet_manager.cc:1397] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:21:31.188807 19270 raft_consensus.cc:348] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a43cb97955e456f8ed57f470ec00326" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 42551 } } peers { permanent_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39321 } } peers { permanent_uuid: "c8e2acc12e454c34b05ae2423cc9808a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45579 } }
I20260806 02:21:31.189118 19270 raft_consensus.cc:374] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:31.189185 19270 raft_consensus.cc:729] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e2acc12e454c34b05ae2423cc9808a, State: Initialized, Role: FOLLOWER
I20260806 02:21:31.189708 19270 consensus_queue.cc:260] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a43cb97955e456f8ed57f470ec00326" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 42551 } } peers { permanent_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39321 } } peers { permanent_uuid: "c8e2acc12e454c34b05ae2423cc9808a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45579 } }
I20260806 02:21:31.189797 19273 raft_consensus.cc:348] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a43cb97955e456f8ed57f470ec00326" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 42551 } } peers { permanent_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39321 } } peers { permanent_uuid: "c8e2acc12e454c34b05ae2423cc9808a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45579 } }
I20260806 02:21:31.190095 19273 raft_consensus.cc:374] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:31.190181 19273 raft_consensus.cc:729] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a43cb97955e456f8ed57f470ec00326, State: Initialized, Role: FOLLOWER
I20260806 02:21:31.190145 19272 raft_consensus.cc:348] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a43cb97955e456f8ed57f470ec00326" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 42551 } } peers { permanent_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39321 } } peers { permanent_uuid: "c8e2acc12e454c34b05ae2423cc9808a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45579 } }
I20260806 02:21:31.190424 19272 raft_consensus.cc:374] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:31.190496 19272 raft_consensus.cc:729] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5688dfbf17ba483ca8ec5c3b0866d1e0, State: Initialized, Role: FOLLOWER
I20260806 02:21:31.190688 19273 consensus_queue.cc:260] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a43cb97955e456f8ed57f470ec00326" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 42551 } } peers { permanent_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39321 } } peers { permanent_uuid: "c8e2acc12e454c34b05ae2423cc9808a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45579 } }
I20260806 02:21:31.190804 19251 heartbeater.cc:503] Master 127.26.189.190:37451 was elected leader, sending a full tablet report...
I20260806 02:21:31.190955 19272 consensus_queue.cc:260] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a43cb97955e456f8ed57f470ec00326" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 42551 } } peers { permanent_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39321 } } peers { permanent_uuid: "c8e2acc12e454c34b05ae2423cc9808a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45579 } }
I20260806 02:21:31.191443 19066 heartbeater.cc:503] Master 127.26.189.190:37451 was elected leader, sending a full tablet report...
I20260806 02:21:31.191947 19272 ts_tablet_manager.cc:1428] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:21:31.191962 19270 ts_tablet_manager.cc:1428] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 02:21:31.192330 18865 heartbeater.cc:503] Master 127.26.189.190:37451 was elected leader, sending a full tablet report...
I20260806 02:21:31.192885 19273 ts_tablet_manager.cc:1428] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:21:31.275211 19278 raft_consensus.cc:482] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:21:31.275521 19278 raft_consensus.cc:504] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a43cb97955e456f8ed57f470ec00326" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 42551 } } peers { permanent_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39321 } } peers { permanent_uuid: "c8e2acc12e454c34b05ae2423cc9808a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45579 } }
I20260806 02:21:31.277336 19278 leader_election.cc:288] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a43cb97955e456f8ed57f470ec00326 (127.26.189.130:42551), 5688dfbf17ba483ca8ec5c3b0866d1e0 (127.26.189.129:39321)
I20260806 02:21:31.283051 19265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.277763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:58683 (local address 127.26.189.130:42551)
0806 02:21:31.277954 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:31.277961 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:31.278210 (+ 249us) server_negotiation.cc:407] Connection header received
0806 02:21:31.278325 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:31.278329 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:31.278399 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:31.278488 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:31.279028 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.279924 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.281428 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.282181 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.282320 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.282408 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:31.282836 (+ 428us) server_negotiation.cc:299] Negotiation successful
0806 02:21:31.282915 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 02:21:31.283051 19253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.277627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:42551 (local address 127.26.189.131:58683)
0806 02:21:31.277953 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:31.277971 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:31.278101 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:31.278691 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:31.278697 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:31.278723 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:31.278873 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.278881 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.280054 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.280058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.281277 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.281287 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.282494 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.282501 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.282654 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.282704 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 02:21:31.282813 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 02:21:31.282894 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236}
I20260806 02:21:31.283645 19281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.277946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:39321 (local address 127.26.189.131:48207)
0806 02:21:31.278968 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:31.278984 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:31.279088 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:31.279375 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:31.279378 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:31.279398 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:31.279528 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.279534 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.280604 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.280610 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.281938 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.281951 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.283028 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.283033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.283321 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.283347 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 02:21:31.283427 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 02:21:31.283498 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"spinlock_wait_cycles":1174912,"thread_start_us":180,"threads_started":1}
I20260806 02:21:31.283691 19269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.278213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:48207 (local address 127.26.189.129:39321)
0806 02:21:31.278354 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:31.278358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:31.279085 (+ 727us) server_negotiation.cc:407] Connection header received
0806 02:21:31.279192 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:31.279196 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:31.279260 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:31.279353 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:31.279725 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.280475 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.282096 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.282769 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.282874 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.282927 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:31.283460 (+ 533us) server_negotiation.cc:299] Negotiation successful
0806 02:21:31.283545 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 02:21:31.283955 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cba0745c03ff4fc5b652183967021b98" candidate_uuid: "c8e2acc12e454c34b05ae2423cc9808a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a43cb97955e456f8ed57f470ec00326" is_pre_election: true
I20260806 02:21:31.284286 19003 raft_consensus.cc:2454] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e2acc12e454c34b05ae2423cc9808a in term 0.
I20260806 02:21:31.284825 19096 leader_election.cc:302] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a43cb97955e456f8ed57f470ec00326, c8e2acc12e454c34b05ae2423cc9808a; no voters:
I20260806 02:21:31.285111 18799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cba0745c03ff4fc5b652183967021b98" candidate_uuid: "c8e2acc12e454c34b05ae2423cc9808a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0" is_pre_election: true
I20260806 02:21:31.285320 19278 raft_consensus.cc:2781] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:21:31.285449 19278 raft_consensus.cc:482] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:21:31.285427 18799 raft_consensus.cc:2454] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e2acc12e454c34b05ae2423cc9808a in term 0.
I20260806 02:21:31.285519 19278 raft_consensus.cc:3037] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:31.286933 19278 raft_consensus.cc:504] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a43cb97955e456f8ed57f470ec00326" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 42551 } } peers { permanent_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39321 } } peers { permanent_uuid: "c8e2acc12e454c34b05ae2423cc9808a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45579 } }
I20260806 02:21:31.287492 19278 leader_election.cc:288] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [CANDIDATE]: Term 1 election: Requested vote from peers 8a43cb97955e456f8ed57f470ec00326 (127.26.189.130:42551), 5688dfbf17ba483ca8ec5c3b0866d1e0 (127.26.189.129:39321)
I20260806 02:21:31.287851 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cba0745c03ff4fc5b652183967021b98" candidate_uuid: "c8e2acc12e454c34b05ae2423cc9808a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a43cb97955e456f8ed57f470ec00326"
I20260806 02:21:31.287936 18799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cba0745c03ff4fc5b652183967021b98" candidate_uuid: "c8e2acc12e454c34b05ae2423cc9808a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0"
I20260806 02:21:31.287990 19003 raft_consensus.cc:3037] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:31.288053 18799 raft_consensus.cc:3037] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:31.289404 19003 raft_consensus.cc:2454] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e2acc12e454c34b05ae2423cc9808a in term 1.
I20260806 02:21:31.289404 18799 raft_consensus.cc:2454] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e2acc12e454c34b05ae2423cc9808a in term 1.
I20260806 02:21:31.289731 19096 leader_election.cc:302] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5688dfbf17ba483ca8ec5c3b0866d1e0, c8e2acc12e454c34b05ae2423cc9808a; no voters:
I20260806 02:21:31.289909 19278 raft_consensus.cc:2781] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:31.290169 19278 raft_consensus.cc:686] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 1 LEADER]: Becoming Leader. State: Replica: c8e2acc12e454c34b05ae2423cc9808a, State: Running, Role: LEADER
I20260806 02:21:31.290494 19278 consensus_queue.cc:237] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a43cb97955e456f8ed57f470ec00326" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 42551 } } peers { permanent_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39321 } } peers { permanent_uuid: "c8e2acc12e454c34b05ae2423cc9808a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45579 } }
I20260806 02:21:31.293716 18601 catalog_manager.cc:5495] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e2acc12e454c34b05ae2423cc9808a (127.26.189.131). New cstate: current_term: 1 leader_uuid: "c8e2acc12e454c34b05ae2423cc9808a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a43cb97955e456f8ed57f470ec00326" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 42551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e2acc12e454c34b05ae2423cc9808a" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260806 02:21:31.324716 19267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.321002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56568 (local address 127.26.189.131:45579)
0806 02:21:31.321156 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:31.321162 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:31.321193 (+ 31us) server_negotiation.cc:407] Connection header received
0806 02:21:31.321342 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:31.321344 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:31.321412 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:31.321524 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:21:31.321826 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.322342 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.323210 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.323439 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.323550 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.323860 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:21:31.324288 (+ 428us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:21:31.324418 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:31.324482 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 02:21:31.324541 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 02:21:31.330806 18799 raft_consensus.cc:1261] T cba0745c03ff4fc5b652183967021b98 P 5688dfbf17ba483ca8ec5c3b0866d1e0 [term 1 FOLLOWER]: Refusing update from remote peer c8e2acc12e454c34b05ae2423cc9808a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:21:31.330840 19003 raft_consensus.cc:1261] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326 [term 1 FOLLOWER]: Refusing update from remote peer c8e2acc12e454c34b05ae2423cc9808a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:21:31.331527 19278 consensus_queue.cc:1035] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5688dfbf17ba483ca8ec5c3b0866d1e0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:21:31.331714 19283 consensus_queue.cc:1035] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a43cb97955e456f8ed57f470ec00326" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 42551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:21:31.339005 19286 mvcc.cc:205] Tried to move back new op lower bound from 7315385922883719168 to 7315385922728714240. Current Snapshot: MvccSnapshot[applied={T|T < 7315385922883719168}]
I20260806 02:21:31.340039 19288 mvcc.cc:205] Tried to move back new op lower bound from 7315385922883719168 to 7315385922728714240. Current Snapshot: MvccSnapshot[applied={T|T < 7315385922883719168}]
I20260806 02:21:31.340590 19287 mvcc.cc:205] Tried to move back new op lower bound from 7315385922883719168 to 7315385922728714240. Current Snapshot: MvccSnapshot[applied={T|T < 7315385922883719168}]
I20260806 02:21:31.347779 18601 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55822:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:21:31.347975 18601 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55822:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:21:31.350458 18601 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7ed3aa3038f4909ad832a70304ec0d0: Sending DeleteTablet for 3 replicas of tablet cba0745c03ff4fc5b652183967021b98
I20260806 02:21:31.351297 19164 tablet_service.cc:1514] Processing DeleteTablet for tablet cba0745c03ff4fc5b652183967021b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:31 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:56562
I20260806 02:21:31.351300 18768 tablet_service.cc:1514] Processing DeleteTablet for tablet cba0745c03ff4fc5b652183967021b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:31 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:59962
I20260806 02:21:31.351426 18970 tablet_service.cc:1514] Processing DeleteTablet for tablet cba0745c03ff4fc5b652183967021b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:31 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:43616
I20260806 02:21:31.351766 19299 tablet_replica.cc:330] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a: stopping tablet replica
I20260806 02:21:31.352044 19299 raft_consensus.cc:2229] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:21:31.352365 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 18685
I20260806 02:21:31.357645 19299 raft_consensus.cc:2258] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:31.359859 19299 ts_tablet_manager.cc:1905] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:21:31.362798 19299 ts_tablet_manager.cc:1918] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:21:31.362910 19299 log.cc:1196] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/cba0745c03ff4fc5b652183967021b98
I20260806 02:21:31.363278 19299 ts_tablet_manager.cc:1939] T cba0745c03ff4fc5b652183967021b98 P c8e2acc12e454c34b05ae2423cc9808a: Deleting consensus metadata
I20260806 02:21:31.364494 18584 catalog_manager.cc:4841] TS c8e2acc12e454c34b05ae2423cc9808a (127.26.189.131:45579): tablet cba0745c03ff4fc5b652183967021b98 (table test-table [id=3b9daa8da55241fbaef3b20ef7af712e]) successfully deleted
I20260806 02:21:31.365744 19301 tablet_replica.cc:330] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326: stopping tablet replica
I20260806 02:21:31.366089 19301 raft_consensus.cc:2229] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:21:31.366497 19301 raft_consensus.cc:2258] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:31.368340 19301 ts_tablet_manager.cc:1905] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:21:31.370522 19301 ts_tablet_manager.cc:1918] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:21:31.370642 19301 log.cc:1196] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/cba0745c03ff4fc5b652183967021b98
I20260806 02:21:31.370949 19301 ts_tablet_manager.cc:1939] T cba0745c03ff4fc5b652183967021b98 P 8a43cb97955e456f8ed57f470ec00326: Deleting consensus metadata
I20260806 02:21:31.372200 18581 catalog_manager.cc:4841] TS 8a43cb97955e456f8ed57f470ec00326 (127.26.189.130:42551): tablet cba0745c03ff4fc5b652183967021b98 (table test-table [id=3b9daa8da55241fbaef3b20ef7af712e]) successfully deleted
W20260806 02:21:31.377748 18581 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:39321 (error 108)
I20260806 02:21:31.378741 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 18872
I20260806 02:21:31.379555 19263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.378847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:39321 (local address 127.0.0.1:59978)
0806 02:21:31.379370 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:31.379450 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:39321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418}
W20260806 02:21:31.383153 18581 catalog_manager.cc:4584] TS 5688dfbf17ba483ca8ec5c3b0866d1e0 (127.26.189.129:39321): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cba0745c03ff4fc5b652183967021b98: Network error: Client connection negotiation failed: client connection to 127.26.189.129:39321: connect: Connection refused (error 111)
I20260806 02:21:31.391626 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 19074
I20260806 02:21:31.401455 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 18556
2026-08-06T02:21:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2653 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T02:21:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:31Z Disabled control of system clock
I20260806 02:21:31.436223 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:42855
--webserver_interface=127.26.189.190
--webserver_port=0
--builtin_ntp_servers=127.26.189.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:42855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 02:21:31.554536 19308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:31.554826 19308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:31.554863 19308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:31.558866 19308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:31.558924 19308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:31.558940 19308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:31.558959 19308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:31.558974 19308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:31.563859 19308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:42855
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:42855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:31.564916 19308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:31.566310 19308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:31.575011 19314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:31.575011 19319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:31.575012 19316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:31.575404 19308 server_base.cc:1034] running on GCE node
I20260806 02:21:31.576001 19308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:31.577030 19308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:31.578191 19308 hybrid_clock.cc:648] HybridClock initialized: now 1785982891578161 us; error 43 us; skew 500 ppm
I20260806 02:21:31.580153 19308 webserver.cc:460] Webserver started at http://127.26.189.190:38731/ using document root <none> and password file <none>
I20260806 02:21:31.580734 19308 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:31.580803 19308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:31.581046 19308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:31.583184 19308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "0c28d7a3fd7a4ca6bd8bdf53cdeb8230"
format_stamp: "Formatted at 2026-08-06 02:21:31 on dist-test-slave-gkw7"
server_key: "95bdee9bc0f7b7179e9137c435f33ec3"
server_key_iv: "df52e45be12732bd5b50e3117794c427"
server_key_version: "encryptionkey@0"
I20260806 02:21:31.583758 19308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "0c28d7a3fd7a4ca6bd8bdf53cdeb8230"
format_stamp: "Formatted at 2026-08-06 02:21:31 on dist-test-slave-gkw7"
server_key: "95bdee9bc0f7b7179e9137c435f33ec3"
server_key_iv: "df52e45be12732bd5b50e3117794c427"
server_key_version: "encryptionkey@0"
I20260806 02:21:31.587450 19308 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 02:21:31.589860 19327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:31.591164 19308 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 02:21:31.591303 19308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "0c28d7a3fd7a4ca6bd8bdf53cdeb8230"
format_stamp: "Formatted at 2026-08-06 02:21:31 on dist-test-slave-gkw7"
server_key: "95bdee9bc0f7b7179e9137c435f33ec3"
server_key_iv: "df52e45be12732bd5b50e3117794c427"
server_key_version: "encryptionkey@0"
I20260806 02:21:31.591410 19308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:31.603894 19308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:31.604548 19308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:31.604744 19308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:31.612078 19308 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:42855
I20260806 02:21:31.612139 19397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:42855 every 8 connection(s)
I20260806 02:21:31.613130 19308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:31.616520 19398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:31.622493 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 19308
I20260806 02:21:31.622581 19398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230: Bootstrap starting.
I20260806 02:21:31.622648 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:31.622924 27382 external_mini_cluster.cc:1428] Setting key bf97c4b1eadd9d3db4bb1dee1fd914e9
I20260806 02:21:31.625398 19398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:31.626307 19398 log.cc:824] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:31.628269 19398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230: No bootstrap required, opened a new log
I20260806 02:21:31.632104 19404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.624340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44112 (local address 127.26.189.190:42855)
0806 02:21:31.625022 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:31.625035 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:31.625071 (+ 36us) server_negotiation.cc:407] Connection header received
0806 02:21:31.625802 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:31.625821 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:31.626227 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:31.626550 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:31.626971 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.627978 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.628923 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.629384 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.629587 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.630417 (+ 830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:31.630422 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:31.630435 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:31.630818 (+ 383us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:31.630872 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:31.630892 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:31.630996 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:31.631111 (+ 115us) server_negotiation.cc:299] Negotiation successful
0806 02:21:31.631366 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":159,"threads_started":1}
I20260806 02:21:31.632136 19398 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c28d7a3fd7a4ca6bd8bdf53cdeb8230" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42855 } }
I20260806 02:21:31.632465 19398 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:31.632546 19398 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c28d7a3fd7a4ca6bd8bdf53cdeb8230, State: Initialized, Role: FOLLOWER
I20260806 02:21:31.633059 19398 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c28d7a3fd7a4ca6bd8bdf53cdeb8230" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42855 } }
I20260806 02:21:31.633220 19398 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:31.633299 19398 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:31.633406 19398 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:31.634500 19398 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c28d7a3fd7a4ca6bd8bdf53cdeb8230" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42855 } }
I20260806 02:21:31.634855 19398 leader_election.cc:302] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c28d7a3fd7a4ca6bd8bdf53cdeb8230; no voters:
I20260806 02:21:31.635174 19398 leader_election.cc:288] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:31.635301 19406 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:31.635536 19406 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [term 1 LEADER]: Becoming Leader. State: Replica: 0c28d7a3fd7a4ca6bd8bdf53cdeb8230, State: Running, Role: LEADER
I20260806 02:21:31.635831 19406 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c28d7a3fd7a4ca6bd8bdf53cdeb8230" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42855 } }
I20260806 02:21:31.636444 19398 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:31.637593 19408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c28d7a3fd7a4ca6bd8bdf53cdeb8230. Latest consensus state: current_term: 1 leader_uuid: "0c28d7a3fd7a4ca6bd8bdf53cdeb8230" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c28d7a3fd7a4ca6bd8bdf53cdeb8230" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42855 } } }
I20260806 02:21:31.637748 19408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:31.638507 19407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c28d7a3fd7a4ca6bd8bdf53cdeb8230" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c28d7a3fd7a4ca6bd8bdf53cdeb8230" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 42855 } } }
I20260806 02:21:31.638815 19407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:31.639179 19417 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:31.642336 19417 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:31.648272 19417 catalog_manager.cc:1347] Generated new cluster ID: 622292e946a045368ddef367492b458f
I20260806 02:21:31.648344 19417 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:31.674316 19417 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:31.675349 19417 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:31.682296 19417 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230: Generated new TSK 0
I20260806 02:21:31.683039 19417 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:31.688032 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42855
--builtin_ntp_servers=127.26.189.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 02:21:31.802879 19436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:31.803161 19436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:31.803231 19436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:31.807221 19436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:31.807302 19436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:31.807389 19436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:21:31.812142 19436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:31.813405 19436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:31.814849 19436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:31.824589 19444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:31.824604 19442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:31.824632 19441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:31.824813 19436 server_base.cc:1034] running on GCE node
I20260806 02:21:31.825337 19436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:31.826103 19436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:31.827291 19436 hybrid_clock.cc:648] HybridClock initialized: now 1785982891827265 us; error 36 us; skew 500 ppm
I20260806 02:21:31.829370 19436 webserver.cc:460] Webserver started at http://127.26.189.129:37803/ using document root <none> and password file <none>
I20260806 02:21:31.830022 19436 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:31.830086 19436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:31.830313 19436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:31.832365 19436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "1b1a1e26ee514dafb2609480697046a0"
format_stamp: "Formatted at 2026-08-06 02:21:31 on dist-test-slave-gkw7"
server_key: "466ac52f231d9f92a779e9e1411766e4"
server_key_iv: "8b84d5af04b12d373327100a1dd0e95a"
server_key_version: "encryptionkey@0"
I20260806 02:21:31.832923 19436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "1b1a1e26ee514dafb2609480697046a0"
format_stamp: "Formatted at 2026-08-06 02:21:31 on dist-test-slave-gkw7"
server_key: "466ac52f231d9f92a779e9e1411766e4"
server_key_iv: "8b84d5af04b12d373327100a1dd0e95a"
server_key_version: "encryptionkey@0"
I20260806 02:21:31.836859 19436 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:21:31.839521 19454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:31.840744 19436 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:31.840860 19436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "1b1a1e26ee514dafb2609480697046a0"
format_stamp: "Formatted at 2026-08-06 02:21:31 on dist-test-slave-gkw7"
server_key: "466ac52f231d9f92a779e9e1411766e4"
server_key_iv: "8b84d5af04b12d373327100a1dd0e95a"
server_key_version: "encryptionkey@0"
I20260806 02:21:31.840991 19436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:31.858306 19436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:31.858966 19436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:31.859164 19436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:31.859724 19436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:31.860649 19436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:31.860718 19436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:31.860806 19436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:31.860852 19436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:31.869454 19436 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:39507
I20260806 02:21:31.869522 19610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:39507 every 8 connection(s)
I20260806 02:21:31.870397 19436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:21:31.875438 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 19436
I20260806 02:21:31.875592 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:21:31.875914 27382 external_mini_cluster.cc:1428] Setting key 6c40ef050937b5b88d53c3cb6b3d4cce
I20260806 02:21:31.878306 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42855
--builtin_ntp_servers=127.26.189.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 02:21:31.882673 19404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.872181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:39973 (local address 127.26.189.190:42855)
0806 02:21:31.872315 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:31.872318 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:31.873672 (+ 1354us) server_negotiation.cc:407] Connection header received
0806 02:21:31.875327 (+ 1655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:31.875332 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:31.875404 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:31.875531 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:31.876637 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.877463 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.880606 (+ 3143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.880834 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.880971 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.882170 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:31.882174 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:31.882177 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:31.882195 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:31.882214 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:31.882223 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:31.882302 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:31.882462 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 02:21:31.882527 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 02:21:31.883694 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:31.872670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:42855 (local address 127.26.189.129:39973)
0806 02:21:31.873438 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:31.873485 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:31.875072 (+ 1587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:31.875738 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:31.875749 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:31.875852 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:31.876460 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.876484 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.877639 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.877643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.879320 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:31.879339 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:31.881012 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:31.881016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:31.881196 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:31.881881 (+ 685us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:21:31.881883 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:31.881924 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:21:31.881989 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:31.882304 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:31.882316 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:31.882324 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 02:21:31.882449 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 02:21:31.882757 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":119,"threads_started":1}
I20260806 02:21:31.884984 19611 heartbeater.cc:347] Connected to a master server at 127.26.189.190:42855
I20260806 02:21:31.885257 19611 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:31.885824 19611 heartbeater.cc:511] Master 127.26.189.190:42855 requested a full tablet report, sending...
I20260806 02:21:31.887598 19351 ts_manager.cc:194] Registered new tserver with Master: 1b1a1e26ee514dafb2609480697046a0 (127.26.189.129:39507)
I20260806 02:21:31.889593 19351 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.189.129:39973
W20260806 02:21:32.000941 19615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:32.001246 19615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:32.001289 19615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:32.005424 19615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:32.005496 19615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:32.005617 19615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:21:32.010476 19615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:32.011637 19615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:32.013078 19615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:32.023542 19622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:32.023554 19621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:32.023806 19615 server_base.cc:1034] running on GCE node
W20260806 02:21:32.023554 19624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:32.024268 19615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:32.024971 19615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:32.026189 19615 hybrid_clock.cc:648] HybridClock initialized: now 1785982892026169 us; error 29 us; skew 500 ppm
I20260806 02:21:32.028288 19615 webserver.cc:460] Webserver started at http://127.26.189.130:43691/ using document root <none> and password file <none>
I20260806 02:21:32.028957 19615 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:32.029060 19615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:32.029316 19615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:32.031555 19615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "bda85fe7c62a4d6da6f63909950c0d45"
format_stamp: "Formatted at 2026-08-06 02:21:32 on dist-test-slave-gkw7"
server_key: "2f984307a741cdee38f4444217670dae"
server_key_iv: "e03c02f4566665fee0d414c5f92acf9f"
server_key_version: "encryptionkey@0"
I20260806 02:21:32.032168 19615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "bda85fe7c62a4d6da6f63909950c0d45"
format_stamp: "Formatted at 2026-08-06 02:21:32 on dist-test-slave-gkw7"
server_key: "2f984307a741cdee38f4444217670dae"
server_key_iv: "e03c02f4566665fee0d414c5f92acf9f"
server_key_version: "encryptionkey@0"
I20260806 02:21:32.036185 19615 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 02:21:32.038923 19631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:32.040189 19615 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 02:21:32.040329 19615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "bda85fe7c62a4d6da6f63909950c0d45"
format_stamp: "Formatted at 2026-08-06 02:21:32 on dist-test-slave-gkw7"
server_key: "2f984307a741cdee38f4444217670dae"
server_key_iv: "e03c02f4566665fee0d414c5f92acf9f"
server_key_version: "encryptionkey@0"
I20260806 02:21:32.040449 19615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:32.068831 19615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:32.069766 19615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:32.070020 19615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:32.070714 19615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:32.071789 19615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:32.071882 19615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:32.071964 19615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:32.072017 19615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:32.082374 19615 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:38981
I20260806 02:21:32.082396 19791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:38981 every 8 connection(s)
I20260806 02:21:32.083429 19615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:21:32.087164 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 19615
I20260806 02:21:32.087317 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:21:32.087638 27382 external_mini_cluster.cc:1428] Setting key 05b2692d8d6be7c412de6e683d4d2784
I20260806 02:21:32.090049 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42855
--builtin_ntp_servers=127.26.189.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 02:21:32.094765 19404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.085384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:41289 (local address 127.26.189.190:42855)
0806 02:21:32.085546 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:32.085550 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:32.086834 (+ 1284us) server_negotiation.cc:407] Connection header received
0806 02:21:32.088739 (+ 1905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:32.088742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:32.088799 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:32.088881 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:32.090087 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.090725 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.092396 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.092621 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.092745 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.094006 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:32.094010 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:32.094012 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:32.094027 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:32.094055 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:32.094064 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:32.094142 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:32.094401 (+ 259us) server_negotiation.cc:299] Negotiation successful
0806 02:21:32.094506 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 02:21:32.095597 19797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.085979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:42855 (local address 127.26.189.130:41289)
0806 02:21:32.086656 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:32.086699 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:32.088500 (+ 1801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:32.089072 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:32.089079 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:32.089166 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:32.089902 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.089927 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.090856 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.090863 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.092231 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.092241 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.092793 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.092798 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.092961 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.093637 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:21:32.093639 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:32.093680 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:21:32.093746 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:32.094146 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:32.094157 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:32.094164 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 02:21:32.094320 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 02:21:32.094579 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":117,"threads_started":1}
I20260806 02:21:32.096760 19795 heartbeater.cc:347] Connected to a master server at 127.26.189.190:42855
I20260806 02:21:32.097018 19795 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:32.097608 19795 heartbeater.cc:511] Master 127.26.189.190:42855 requested a full tablet report, sending...
I20260806 02:21:32.098701 19351 ts_manager.cc:194] Registered new tserver with Master: bda85fe7c62a4d6da6f63909950c0d45 (127.26.189.130:38981)
I20260806 02:21:32.099313 19351 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.189.130:41289
W20260806 02:21:32.210342 19798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:32.210625 19798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:32.210690 19798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:32.214869 19798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:32.214952 19798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:32.215042 19798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:21:32.219892 19798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:42855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:32.221036 19798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:32.222589 19798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 02:21:32.232376 19798 server_base.cc:1034] running on GCE node
W20260806 02:21:32.232304 19811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:32.232301 19806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:32.232301 19808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:32.233064 19798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:32.233712 19798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:32.234906 19798 hybrid_clock.cc:648] HybridClock initialized: now 1785982892234873 us; error 42 us; skew 500 ppm
I20260806 02:21:32.236828 19798 webserver.cc:460] Webserver started at http://127.26.189.131:45595/ using document root <none> and password file <none>
I20260806 02:21:32.237462 19798 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:32.237571 19798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:32.237818 19798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:32.239964 19798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "b53f415bfa9041be8572b892a5e94659"
format_stamp: "Formatted at 2026-08-06 02:21:32 on dist-test-slave-gkw7"
server_key: "430f42777bb1bfc2fcd900c464fdadce"
server_key_iv: "caf5b09f1bcc4db59d6a6315b3aa771a"
server_key_version: "encryptionkey@0"
I20260806 02:21:32.240545 19798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "b53f415bfa9041be8572b892a5e94659"
format_stamp: "Formatted at 2026-08-06 02:21:32 on dist-test-slave-gkw7"
server_key: "430f42777bb1bfc2fcd900c464fdadce"
server_key_iv: "caf5b09f1bcc4db59d6a6315b3aa771a"
server_key_version: "encryptionkey@0"
I20260806 02:21:32.244385 19798 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260806 02:21:32.247028 19819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:32.248273 19798 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 02:21:32.248395 19798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "b53f415bfa9041be8572b892a5e94659"
format_stamp: "Formatted at 2026-08-06 02:21:32 on dist-test-slave-gkw7"
server_key: "430f42777bb1bfc2fcd900c464fdadce"
server_key_iv: "caf5b09f1bcc4db59d6a6315b3aa771a"
server_key_version: "encryptionkey@0"
I20260806 02:21:32.248497 19798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:32.264493 19798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:32.265193 19798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:32.265391 19798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:32.266073 19798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:32.267027 19798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:32.267076 19798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:32.267150 19798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:32.267184 19798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:32.276461 19798 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:39565
I20260806 02:21:32.276484 19974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:39565 every 8 connection(s)
I20260806 02:21:32.277372 19798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:21:32.278019 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 19798
I20260806 02:21:32.278157 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:21:32.278515 27382 external_mini_cluster.cc:1428] Setting key 6925685d519b95e8d6f32aee4ed787e4
I20260806 02:21:32.286849 19404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.281044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:42013 (local address 127.26.189.190:42855)
0806 02:21:32.281188 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:32.281192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:32.281204 (+ 12us) server_negotiation.cc:407] Connection header received
0806 02:21:32.282453 (+ 1249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:32.282455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:32.282499 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:32.282565 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:32.283412 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.283936 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.285073 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.285306 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.285381 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.286460 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:32.286463 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:32.286465 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:32.286476 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:32.286494 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:32.286501 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:32.286557 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:32.286685 (+ 128us) server_negotiation.cc:299] Negotiation successful
0806 02:21:32.286734 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 02:21:32.287747 19977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.280047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:42855 (local address 127.26.189.131:42013)
0806 02:21:32.280789 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:32.280842 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:32.282262 (+ 1420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:32.282704 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:32.282711 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:32.282796 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:32.283290 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.283303 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.284042 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.284044 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.284965 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.284975 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.285429 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.285432 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.285633 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.286218 (+ 585us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:21:32.286219 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:32.286259 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:21:32.286321 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:32.286570 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:32.286576 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:32.286580 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 02:21:32.286673 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 02:21:32.286884 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":138,"threads_started":1}
I20260806 02:21:32.288803 19975 heartbeater.cc:347] Connected to a master server at 127.26.189.190:42855
I20260806 02:21:32.289040 19975 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:32.289618 19975 heartbeater.cc:511] Master 127.26.189.190:42855 requested a full tablet report, sending...
I20260806 02:21:32.290602 19351 ts_manager.cc:194] Registered new tserver with Master: b53f415bfa9041be8572b892a5e94659 (127.26.189.131:39565)
I20260806 02:21:32.291311 19351 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.189.131:42013
I20260806 02:21:32.292641 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:21:32.298354 19404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.294645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44118 (local address 127.26.189.190:42855)
0806 02:21:32.294754 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:32.294758 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:32.294955 (+ 197us) server_negotiation.cc:407] Connection header received
0806 02:21:32.295008 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:32.295010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:32.295050 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:32.295169 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:32.295387 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.296061 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.296861 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.297125 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.297212 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.297983 (+ 771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:32.297986 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:32.297988 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:32.297999 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:32.298015 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:32.298023 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:32.298121 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:32.298184 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 02:21:32.298230 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 02:21:32.301028 19351 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:21:32.304008 19351 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:21:32.318179 19992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.311998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:39565 (local address 127.0.0.1:40498)
0806 02:21:32.312815 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:32.312868 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:32.312995 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:32.314309 (+ 1314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:32.314312 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:32.314332 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:32.314444 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.314451 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.315401 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.315405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.316653 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.316663 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.317620 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.317624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.317731 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.317772 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 02:21:32.317899 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 02:21:32.318023 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"mutex_wait_us":26,"thread_start_us":73,"threads_started":1}
I20260806 02:21:32.318226 19995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.312141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40498 (local address 127.26.189.131:39565)
0806 02:21:32.313711 (+ 1570us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:32.313722 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:32.313741 (+ 19us) server_negotiation.cc:407] Connection header received
0806 02:21:32.313818 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:32.313823 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:32.314022 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:32.314174 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:32.314559 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.315282 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.316781 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.317480 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.317636 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.317813 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:32.317927 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 02:21:32.318052 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1480,"thread_start_us":148,"threads_started":1}
I20260806 02:21:32.318600 19996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.312331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:39507 (local address 127.0.0.1:43354)
0806 02:21:32.313289 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:32.313303 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:32.313387 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:32.314176 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:32.314179 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:32.314201 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:32.314285 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.314290 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.315960 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.315963 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.317064 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.317075 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.318188 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.318194 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.318310 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.318335 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 02:21:32.318410 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 02:21:32.318483 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":880,"thread_start_us":99,"threads_started":1}
I20260806 02:21:32.319162 19998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.312826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43354 (local address 127.26.189.129:39507)
0806 02:21:32.313659 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:32.313670 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:32.313693 (+ 23us) server_negotiation.cc:407] Connection header received
0806 02:21:32.313763 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:32.313767 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:32.313920 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:32.314040 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:32.314420 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.315616 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.317194 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.317859 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.317970 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.318126 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:32.318806 (+ 680us) server_negotiation.cc:299] Negotiation successful
0806 02:21:32.318951 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":727,"thread_start_us":118,"threads_started":1}
I20260806 02:21:32.319824 19993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.312042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:38981 (local address 127.0.0.1:47442)
0806 02:21:32.313238 (+ 1196us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:32.313249 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:32.313427 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:32.314080 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:32.314089 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:32.314129 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:32.314290 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.314299 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.315760 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.315764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.316995 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.317007 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.319417 (+ 2410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.319421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.319495 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.319513 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 02:21:32.319602 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 02:21:32.319686 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1142,"mutex_wait_us":30,"thread_start_us":106,"threads_started":1}
I20260806 02:21:32.320053 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.312674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47442 (local address 127.26.189.130:38981)
0806 02:21:32.313088 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:32.313101 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:32.313350 (+ 249us) server_negotiation.cc:407] Connection header received
0806 02:21:32.313607 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:32.313614 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:32.313852 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:32.314005 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:32.314444 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.315635 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.317130 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.317946 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.318060 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.318224 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:32.319636 (+ 1412us) server_negotiation.cc:299] Negotiation successful
0806 02:21:32.319726 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":101,"threads_started":1}
I20260806 02:21:32.321841 19520 tablet_service.cc:1467] Processing CreateTablet for tablet 8deda7999df8472d9f6824984828817b (DEFAULT_TABLE table=test-table [id=7da367861a9448c3a3c19b61fa75d808]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:32.321679 19880 tablet_service.cc:1467] Processing CreateTablet for tablet 8deda7999df8472d9f6824984828817b (DEFAULT_TABLE table=test-table [id=7da367861a9448c3a3c19b61fa75d808]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:32.322368 19693 tablet_service.cc:1467] Processing CreateTablet for tablet 8deda7999df8472d9f6824984828817b (DEFAULT_TABLE table=test-table [id=7da367861a9448c3a3c19b61fa75d808]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:32.322837 19880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8deda7999df8472d9f6824984828817b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:32.322837 19520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8deda7999df8472d9f6824984828817b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:32.323283 19693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8deda7999df8472d9f6824984828817b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:32.329331 19999 tablet_bootstrap.cc:492] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45: Bootstrap starting.
I20260806 02:21:32.330767 20002 tablet_bootstrap.cc:492] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0: Bootstrap starting.
I20260806 02:21:32.330775 20000 tablet_bootstrap.cc:492] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659: Bootstrap starting.
I20260806 02:21:32.331638 19999 tablet_bootstrap.cc:654] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:32.332355 19999 log.cc:824] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:32.332881 20000 tablet_bootstrap.cc:654] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:32.332882 20002 tablet_bootstrap.cc:654] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:32.333760 20000 log.cc:824] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:32.333752 20002 log.cc:824] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:32.334743 19999 tablet_bootstrap.cc:492] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45: No bootstrap required, opened a new log
I20260806 02:21:32.334897 19999 ts_tablet_manager.cc:1397] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 02:21:32.338169 19999 raft_consensus.cc:348] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53f415bfa9041be8572b892a5e94659" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 39565 } } peers { permanent_uuid: "bda85fe7c62a4d6da6f63909950c0d45" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 38981 } } peers { permanent_uuid: "1b1a1e26ee514dafb2609480697046a0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39507 } }
I20260806 02:21:32.338425 19999 raft_consensus.cc:374] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:32.338480 19999 raft_consensus.cc:729] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda85fe7c62a4d6da6f63909950c0d45, State: Initialized, Role: FOLLOWER
I20260806 02:21:32.338934 19999 consensus_queue.cc:260] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53f415bfa9041be8572b892a5e94659" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 39565 } } peers { permanent_uuid: "bda85fe7c62a4d6da6f63909950c0d45" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 38981 } } peers { permanent_uuid: "1b1a1e26ee514dafb2609480697046a0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39507 } }
I20260806 02:21:32.339124 20002 tablet_bootstrap.cc:492] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0: No bootstrap required, opened a new log
I20260806 02:21:32.339291 20000 tablet_bootstrap.cc:492] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659: No bootstrap required, opened a new log
I20260806 02:21:32.339326 20002 ts_tablet_manager.cc:1397] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.004s
I20260806 02:21:32.339471 20000 ts_tablet_manager.cc:1397] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260806 02:21:32.339782 19795 heartbeater.cc:503] Master 127.26.189.190:42855 was elected leader, sending a full tablet report...
I20260806 02:21:32.340054 19999 ts_tablet_manager.cc:1428] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 02:21:32.343158 20000 raft_consensus.cc:348] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53f415bfa9041be8572b892a5e94659" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 39565 } } peers { permanent_uuid: "bda85fe7c62a4d6da6f63909950c0d45" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 38981 } } peers { permanent_uuid: "1b1a1e26ee514dafb2609480697046a0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39507 } }
I20260806 02:21:32.343387 20000 raft_consensus.cc:374] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:32.343443 20000 raft_consensus.cc:729] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b53f415bfa9041be8572b892a5e94659, State: Initialized, Role: FOLLOWER
I20260806 02:21:32.343660 20002 raft_consensus.cc:348] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53f415bfa9041be8572b892a5e94659" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 39565 } } peers { permanent_uuid: "bda85fe7c62a4d6da6f63909950c0d45" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 38981 } } peers { permanent_uuid: "1b1a1e26ee514dafb2609480697046a0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39507 } }
I20260806 02:21:32.343907 20000 consensus_queue.cc:260] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53f415bfa9041be8572b892a5e94659" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 39565 } } peers { permanent_uuid: "bda85fe7c62a4d6da6f63909950c0d45" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 38981 } } peers { permanent_uuid: "1b1a1e26ee514dafb2609480697046a0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39507 } }
I20260806 02:21:32.344000 20002 raft_consensus.cc:374] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:32.344076 20002 raft_consensus.cc:729] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1a1e26ee514dafb2609480697046a0, State: Initialized, Role: FOLLOWER
I20260806 02:21:32.344578 19975 heartbeater.cc:503] Master 127.26.189.190:42855 was elected leader, sending a full tablet report...
I20260806 02:21:32.344655 20002 consensus_queue.cc:260] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53f415bfa9041be8572b892a5e94659" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 39565 } } peers { permanent_uuid: "bda85fe7c62a4d6da6f63909950c0d45" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 38981 } } peers { permanent_uuid: "1b1a1e26ee514dafb2609480697046a0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39507 } }
I20260806 02:21:32.344936 20000 ts_tablet_manager.cc:1428] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 02:21:32.345260 19611 heartbeater.cc:503] Master 127.26.189.190:42855 was elected leader, sending a full tablet report...
I20260806 02:21:32.345419 20012 raft_consensus.cc:482] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:21:32.345626 20012 raft_consensus.cc:504] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53f415bfa9041be8572b892a5e94659" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 39565 } } peers { permanent_uuid: "bda85fe7c62a4d6da6f63909950c0d45" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 38981 } } peers { permanent_uuid: "1b1a1e26ee514dafb2609480697046a0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39507 } }
I20260806 02:21:32.346587 20002 ts_tablet_manager.cc:1428] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20260806 02:21:32.347468 20012 leader_election.cc:288] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda85fe7c62a4d6da6f63909950c0d45 (127.26.189.130:38981), 1b1a1e26ee514dafb2609480697046a0 (127.26.189.129:39507)
I20260806 02:21:32.351018 19977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.346916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:38981 (local address 127.26.189.131:49091)
0806 02:21:32.347186 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:32.347203 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:32.347285 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:32.347601 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:32.347606 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:32.347625 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:32.347751 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.347760 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.348795 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.348799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.349855 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.349864 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.350652 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.350654 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.350795 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.350815 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 02:21:32.350872 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 02:21:32.350923 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":35}
I20260806 02:21:32.351099 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.347149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:49091 (local address 127.26.189.130:38981)
0806 02:21:32.347269 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:32.347274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:32.347289 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:21:32.347360 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:32.347363 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:32.347406 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:32.347480 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:32.347887 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.348669 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.349953 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.350535 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.350659 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.350714 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:32.350905 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 02:21:32.350973 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 02:21:32.351598 19723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8deda7999df8472d9f6824984828817b" candidate_uuid: "b53f415bfa9041be8572b892a5e94659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda85fe7c62a4d6da6f63909950c0d45" is_pre_election: true
I20260806 02:21:32.351861 19723 raft_consensus.cc:2454] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b53f415bfa9041be8572b892a5e94659 in term 0.
I20260806 02:21:32.352368 19820 leader_election.cc:302] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b53f415bfa9041be8572b892a5e94659, bda85fe7c62a4d6da6f63909950c0d45; no voters:
I20260806 02:21:32.352561 19998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.347774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:37743 (local address 127.26.189.129:39507)
0806 02:21:32.348145 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:32.348148 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:32.348355 (+ 207us) server_negotiation.cc:407] Connection header received
0806 02:21:32.348534 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:32.348537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:32.348583 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:32.348635 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:32.349036 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.349758 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.351447 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.352041 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.352163 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.352207 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:32.352398 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 02:21:32.352463 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294}
I20260806 02:21:32.352587 20018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.347666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:39507 (local address 127.26.189.131:37743)
0806 02:21:32.348280 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:32.348295 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:32.348420 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:32.348784 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:32.348786 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:32.348803 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:32.348936 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.348944 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.349861 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.349866 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.351038 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:32.351048 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.352156 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.352160 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:32.352263 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.352284 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 02:21:32.352369 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 02:21:32.352436 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"mutex_wait_us":31,"thread_start_us":95,"threads_started":1}
I20260806 02:21:32.352644 20012 raft_consensus.cc:2781] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:21:32.352723 20012 raft_consensus.cc:482] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:21:32.352756 20012 raft_consensus.cc:3037] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:32.353261 19545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8deda7999df8472d9f6824984828817b" candidate_uuid: "b53f415bfa9041be8572b892a5e94659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1a1e26ee514dafb2609480697046a0" is_pre_election: true
I20260806 02:21:32.353506 19545 raft_consensus.cc:2454] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b53f415bfa9041be8572b892a5e94659 in term 0.
I20260806 02:21:32.354027 20012 raft_consensus.cc:504] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53f415bfa9041be8572b892a5e94659" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 39565 } } peers { permanent_uuid: "bda85fe7c62a4d6da6f63909950c0d45" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 38981 } } peers { permanent_uuid: "1b1a1e26ee514dafb2609480697046a0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39507 } }
I20260806 02:21:32.354372 20012 leader_election.cc:288] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [CANDIDATE]: Term 1 election: Requested vote from peers bda85fe7c62a4d6da6f63909950c0d45 (127.26.189.130:38981), 1b1a1e26ee514dafb2609480697046a0 (127.26.189.129:39507)
I20260806 02:21:32.354689 19723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8deda7999df8472d9f6824984828817b" candidate_uuid: "b53f415bfa9041be8572b892a5e94659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda85fe7c62a4d6da6f63909950c0d45"
I20260806 02:21:32.354766 19545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8deda7999df8472d9f6824984828817b" candidate_uuid: "b53f415bfa9041be8572b892a5e94659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1a1e26ee514dafb2609480697046a0"
I20260806 02:21:32.354803 19723 raft_consensus.cc:3037] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:32.354905 19545 raft_consensus.cc:3037] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:32.355821 19723 raft_consensus.cc:2454] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b53f415bfa9041be8572b892a5e94659 in term 1.
I20260806 02:21:32.355960 19545 raft_consensus.cc:2454] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b53f415bfa9041be8572b892a5e94659 in term 1.
I20260806 02:21:32.356170 19820 leader_election.cc:302] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b53f415bfa9041be8572b892a5e94659, bda85fe7c62a4d6da6f63909950c0d45; no voters:
I20260806 02:21:32.356353 20012 raft_consensus.cc:2781] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:32.356456 20012 raft_consensus.cc:686] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 1 LEADER]: Becoming Leader. State: Replica: b53f415bfa9041be8572b892a5e94659, State: Running, Role: LEADER
I20260806 02:21:32.356729 20012 consensus_queue.cc:237] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53f415bfa9041be8572b892a5e94659" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 39565 } } peers { permanent_uuid: "bda85fe7c62a4d6da6f63909950c0d45" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 38981 } } peers { permanent_uuid: "1b1a1e26ee514dafb2609480697046a0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39507 } }
I20260806 02:21:32.359732 19349 catalog_manager.cc:5495] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 reported cstate change: term changed from 0 to 1, leader changed from <none> to b53f415bfa9041be8572b892a5e94659 (127.26.189.131). New cstate: current_term: 1 leader_uuid: "b53f415bfa9041be8572b892a5e94659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53f415bfa9041be8572b892a5e94659" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda85fe7c62a4d6da6f63909950c0d45" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1a1e26ee514dafb2609480697046a0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39507 } health_report { overall_health: UNKNOWN } } }
W20260806 02:21:32.371603 19612 tablet.cc:2369] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:21:32.380080 19995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.376660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40512 (local address 127.26.189.131:39565)
0806 02:21:32.376790 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:32.376794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:32.376807 (+ 13us) server_negotiation.cc:407] Connection header received
0806 02:21:32.376876 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:32.376878 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:32.376927 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:32.377013 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:21:32.377264 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.377786 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.378692 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:32.378918 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:32.378999 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:32.379289 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:21:32.379698 (+ 409us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:21:32.379792 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:32.379924 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 02:21:32.379974 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 02:21:32.385993 19723 raft_consensus.cc:1261] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45 [term 1 FOLLOWER]: Refusing update from remote peer b53f415bfa9041be8572b892a5e94659: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:21:32.385993 19545 raft_consensus.cc:1261] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0 [term 1 FOLLOWER]: Refusing update from remote peer b53f415bfa9041be8572b892a5e94659: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:21:32.386687 20016 consensus_queue.cc:1035] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda85fe7c62a4d6da6f63909950c0d45" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:21:32.386873 20012 consensus_queue.cc:1035] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1a1e26ee514dafb2609480697046a0" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:21:32.404577 19351 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:21:32.404726 19351 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:21:32.407063 19351 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c28d7a3fd7a4ca6bd8bdf53cdeb8230: Sending DeleteTablet for 3 replicas of tablet 8deda7999df8472d9f6824984828817b
I20260806 02:21:32.407876 19693 tablet_service.cc:1514] Processing DeleteTablet for tablet 8deda7999df8472d9f6824984828817b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:32 UTC) from {username='slave'} at 127.0.0.1:47442
I20260806 02:21:32.408100 19520 tablet_service.cc:1514] Processing DeleteTablet for tablet 8deda7999df8472d9f6824984828817b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:32 UTC) from {username='slave'} at 127.0.0.1:43354
I20260806 02:21:32.408428 19880 tablet_service.cc:1514] Processing DeleteTablet for tablet 8deda7999df8472d9f6824984828817b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:32 UTC) from {username='slave'} at 127.0.0.1:40498
I20260806 02:21:32.408640 20037 tablet_replica.cc:330] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0: stopping tablet replica
I20260806 02:21:32.408807 20034 tablet_replica.cc:330] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45: stopping tablet replica
I20260806 02:21:32.409015 20037 raft_consensus.cc:2229] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:21:32.409063 20034 raft_consensus.cc:2229] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:21:32.409209 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 19436
I20260806 02:21:32.409318 20034 raft_consensus.cc:2258] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:32.409318 20037 raft_consensus.cc:2258] T 8deda7999df8472d9f6824984828817b P 1b1a1e26ee514dafb2609480697046a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:32.409837 20038 tablet_replica.cc:330] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659: stopping tablet replica
I20260806 02:21:32.411603 20034 ts_tablet_manager.cc:1905] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:21:32.412380 20038 raft_consensus.cc:2229] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:21:32.412786 20038 raft_consensus.cc:2258] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:32.415679 20034 ts_tablet_manager.cc:1918] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:21:32.416394 20034 log.cc:1196] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/8deda7999df8472d9f6824984828817b
I20260806 02:21:32.416766 20034 ts_tablet_manager.cc:1939] T 8deda7999df8472d9f6824984828817b P bda85fe7c62a4d6da6f63909950c0d45: Deleting consensus metadata
I20260806 02:21:32.418943 20038 ts_tablet_manager.cc:1905] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:21:32.420322 19328 catalog_manager.cc:4841] TS bda85fe7c62a4d6da6f63909950c0d45 (127.26.189.130:38981): tablet 8deda7999df8472d9f6824984828817b (table test-table [id=7da367861a9448c3a3c19b61fa75d808]) successfully deleted
I20260806 02:21:32.422746 20038 ts_tablet_manager.cc:1918] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:21:32.422873 20038 log.cc:1196] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/8deda7999df8472d9f6824984828817b
I20260806 02:21:32.423198 20038 ts_tablet_manager.cc:1939] T 8deda7999df8472d9f6824984828817b P b53f415bfa9041be8572b892a5e94659: Deleting consensus metadata
I20260806 02:21:32.424288 19329 catalog_manager.cc:4841] TS b53f415bfa9041be8572b892a5e94659 (127.26.189.131:39565): tablet 8deda7999df8472d9f6824984828817b (table test-table [id=7da367861a9448c3a3c19b61fa75d808]) successfully deleted
W20260806 02:21:32.429571 19330 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:39507 (error 108)
I20260806 02:21:32.429769 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 19615
I20260806 02:21:32.434939 19993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:32.434180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:39507 (local address 127.0.0.1:43366)
0806 02:21:32.434750 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:32.434835 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:39507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451}
W20260806 02:21:32.436733 19330 catalog_manager.cc:4584] TS 1b1a1e26ee514dafb2609480697046a0 (127.26.189.129:39507): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8deda7999df8472d9f6824984828817b: Network error: Client connection negotiation failed: client connection to 127.26.189.129:39507: connect: Connection refused (error 111)
I20260806 02:21:32.442188 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 19798
I20260806 02:21:32.451241 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 19308
2026-08-06T02:21:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1049 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:32 dist-test-slave-gkw7 krb5kdc[20045](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:32 dist-test-slave-gkw7 krb5kdc[20045](info): set up 2 sockets
Aug 06 02:21:32 dist-test-slave-gkw7 krb5kdc[20045](info): commencing operation
krb5kdc: starting...
W20260806 02:21:33.670499 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:33 dist-test-slave-gkw7 krb5kdc[20045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:21:33.804328 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:38555
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:38555
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:33.922669 20062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:33.922964 20062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:33.923048 20062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:33.927102 20062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:33.927184 20062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:33.927219 20062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:33.927271 20062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:33.927309 20062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:33.932659 20062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:38555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:38555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:33.933827 20062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:33.934904 20062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:33.944067 20069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:33.944178 20062 server_base.cc:1034] running on GCE node
W20260806 02:21:33.944072 20070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:33.944058 20076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:33.944974 20062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:33.946200 20062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:33.947371 20062 hybrid_clock.cc:648] HybridClock initialized: now 1785982893947356 us; error 26 us; skew 500 ppm
Aug 06 02:21:33 dist-test-slave-gkw7 krb5kdc[20045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982893, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:33.954347 20062 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:21:33.955358 20062 webserver.cc:460] Webserver started at http://127.26.189.190:35243/ using document root <none> and password file <none>
I20260806 02:21:33.955960 20062 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:33.956045 20062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:33.956278 20062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:33.958530 20062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "e3de985c6c8d4fb1983aa1d37c8e49f7"
format_stamp: "Formatted at 2026-08-06 02:21:33 on dist-test-slave-gkw7"
server_key: "bf84626ee5a07e1ee7748ba761e16a10"
server_key_iv: "239e336bccdcf6d0dd01716e4c03a374"
server_key_version: "encryptionkey@0"
I20260806 02:21:33.959146 20062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "e3de985c6c8d4fb1983aa1d37c8e49f7"
format_stamp: "Formatted at 2026-08-06 02:21:33 on dist-test-slave-gkw7"
server_key: "bf84626ee5a07e1ee7748ba761e16a10"
server_key_iv: "239e336bccdcf6d0dd01716e4c03a374"
server_key_version: "encryptionkey@0"
I20260806 02:21:33.963038 20062 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:21:33.965916 20085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:33.967181 20062 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260806 02:21:33.967329 20062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "e3de985c6c8d4fb1983aa1d37c8e49f7"
format_stamp: "Formatted at 2026-08-06 02:21:33 on dist-test-slave-gkw7"
server_key: "bf84626ee5a07e1ee7748ba761e16a10"
server_key_iv: "239e336bccdcf6d0dd01716e4c03a374"
server_key_version: "encryptionkey@0"
I20260806 02:21:33.967446 20062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:33.996505 20062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:33.999676 20062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:33.999943 20062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:34.007591 20062 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:38555
I20260806 02:21:34.007620 20151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:38555 every 8 connection(s)
I20260806 02:21:34.008594 20062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:34.011442 20153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:34.012401 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 20062
I20260806 02:21:34.012550 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:34.012914 27382 external_mini_cluster.cc:1428] Setting key 95ae4844cf8a5434cd5ea18d4bcb403a
I20260806 02:21:34.017796 20153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7: Bootstrap starting.
I20260806 02:21:34.020154 20153 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:34.020902 20153 log.cc:824] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7: Log is configured to *not* fsync() on all Append() calls
Aug 06 02:21:34 dist-test-slave-gkw7 krb5kdc[20045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:21:34.022967 20153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7: No bootstrap required, opened a new log
I20260806 02:21:34.026614 20153 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3de985c6c8d4fb1983aa1d37c8e49f7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 38555 } }
I20260806 02:21:34.026854 20153 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:34.026913 20153 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3de985c6c8d4fb1983aa1d37c8e49f7, State: Initialized, Role: FOLLOWER
I20260806 02:21:34.027222 20157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.014415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46878 (local address 127.26.189.190:38555)
0806 02:21:34.014836 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:34.014851 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:34.014886 (+ 35us) server_negotiation.cc:407] Connection header received
0806 02:21:34.015525 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:34.015542 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:34.015892 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:34.016241 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:34.017081 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.018266 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.019125 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.019614 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.019786 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.022420 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:34.022425 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:34.022440 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:34.022466 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:34.024231 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:34.024685 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:34.024690 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:34.024695 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:34.024809 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:34.025098 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:34.025101 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:34.025103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:34.025495 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:34.025782 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:34.026041 (+ 259us) server_negotiation.cc:299] Negotiation successful
0806 02:21:34.026343 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":129,"threads_started":1}
I20260806 02:21:34.027402 20153 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3de985c6c8d4fb1983aa1d37c8e49f7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 38555 } }
I20260806 02:21:34.027577 20153 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:34.027661 20153 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:34.027767 20153 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:34.028653 20153 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3de985c6c8d4fb1983aa1d37c8e49f7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 38555 } }
I20260806 02:21:34.029004 20153 leader_election.cc:302] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3de985c6c8d4fb1983aa1d37c8e49f7; no voters:
I20260806 02:21:34.029366 20153 leader_election.cc:288] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:34.029413 20160 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:34.029659 20160 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [term 1 LEADER]: Becoming Leader. State: Replica: e3de985c6c8d4fb1983aa1d37c8e49f7, State: Running, Role: LEADER
I20260806 02:21:34.029980 20160 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3de985c6c8d4fb1983aa1d37c8e49f7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 38555 } }
I20260806 02:21:34.030676 20153 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:34.031940 20161 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3de985c6c8d4fb1983aa1d37c8e49f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3de985c6c8d4fb1983aa1d37c8e49f7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 38555 } } }
I20260806 02:21:34.031960 20162 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3de985c6c8d4fb1983aa1d37c8e49f7. Latest consensus state: current_term: 1 leader_uuid: "e3de985c6c8d4fb1983aa1d37c8e49f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3de985c6c8d4fb1983aa1d37c8e49f7" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 38555 } } }
I20260806 02:21:34.032099 20161 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:34.032111 20162 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:34.032528 20174 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:34.035640 20174 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:34.041409 20174 catalog_manager.cc:1347] Generated new cluster ID: 7b522dda5af7498c934eade5a66f020c
I20260806 02:21:34.041491 20174 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:34.066773 20174 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:34.067920 20174 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:34.073617 20174 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7: Generated new TSK 0
I20260806 02:21:34.074450 20174 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:21:34.105832 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:38555
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:34.224367 20186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:34.224654 20186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:34.224727 20186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:34.228754 20186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:34.228838 20186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:34.228928 20186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:21:34.234364 20186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:38555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:34.235424 20186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:34.236476 20186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:34.246376 20199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:34.246488 20197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:34.246376 20195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:34.246729 20186 server_base.cc:1034] running on GCE node
I20260806 02:21:34.247138 20186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:34.247817 20186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:34.249018 20186 hybrid_clock.cc:648] HybridClock initialized: now 1785982894248964 us; error 70 us; skew 500 ppm
Aug 06 02:21:34 dist-test-slave-gkw7 krb5kdc[20045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982894, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:34.251937 20186 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:21:34.252866 20186 webserver.cc:460] Webserver started at http://127.26.189.129:36945/ using document root <none> and password file <none>
I20260806 02:21:34.253396 20186 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:34.253460 20186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:34.253707 20186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:34.255800 20186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "2754c7dcfa9b44ddb03b55041e24b646"
format_stamp: "Formatted at 2026-08-06 02:21:34 on dist-test-slave-gkw7"
server_key: "04b8258e7b52bfcda91131947272d6a4"
server_key_iv: "a0aeb891db4be1781c7e6f104ec0d676"
server_key_version: "encryptionkey@0"
I20260806 02:21:34.256330 20186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "2754c7dcfa9b44ddb03b55041e24b646"
format_stamp: "Formatted at 2026-08-06 02:21:34 on dist-test-slave-gkw7"
server_key: "04b8258e7b52bfcda91131947272d6a4"
server_key_iv: "a0aeb891db4be1781c7e6f104ec0d676"
server_key_version: "encryptionkey@0"
I20260806 02:21:34.260190 20186 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:21:34.263002 20208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:34.264343 20186 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 02:21:34.264462 20186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "2754c7dcfa9b44ddb03b55041e24b646"
format_stamp: "Formatted at 2026-08-06 02:21:34 on dist-test-slave-gkw7"
server_key: "04b8258e7b52bfcda91131947272d6a4"
server_key_iv: "a0aeb891db4be1781c7e6f104ec0d676"
server_key_version: "encryptionkey@0"
I20260806 02:21:34.264561 20186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:34.284266 20186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:34.287932 20186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:34.288129 20186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:34.288720 20186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:34.289664 20186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:34.289721 20186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:34.289768 20186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:34.289788 20186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:34.299521 20186 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:45397
I20260806 02:21:34.299544 20369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:45397 every 8 connection(s)
I20260806 02:21:34.300529 20186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:21:34.303272 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 20186
I20260806 02:21:34.303449 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:21:34.303834 27382 external_mini_cluster.cc:1428] Setting key 2e920fa4517895e7833b1bbe5858fc8e
Aug 06 02:21:34 dist-test-slave-gkw7 krb5kdc[20045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982894, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
I20260806 02:21:34.315656 20157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.302609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:57857 (local address 127.26.189.190:38555)
0806 02:21:34.302756 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:34.302760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:34.303801 (+ 1041us) server_negotiation.cc:407] Connection header received
0806 02:21:34.305592 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:34.305596 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:34.305648 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:34.305735 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:34.306966 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.307840 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.309016 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.309273 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.309378 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.311946 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:34.311950 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:34.311953 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:34.311981 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:34.313402 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:34.313935 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:34.313940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:34.313942 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:34.314022 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:34.314391 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:34.314394 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:34.314396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:34.314659 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:34.314751 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:34.315402 (+ 651us) server_negotiation.cc:299] Negotiation successful
0806 02:21:34.315514 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 02:21:34.316390 20373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.303009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:38555 (local address 127.26.189.129:57857)
0806 02:21:34.303645 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:34.303690 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:34.305299 (+ 1609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:34.305906 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:34.305912 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:34.306295 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:34.306809 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.306825 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.307976 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.307979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.308888 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.308898 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.309431 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.309435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.309659 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.310257 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:21:34.310275 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:34.311786 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:34.313523 (+ 1737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:34.313549 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:34.313565 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:34.313833 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:34.314114 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:34.314118 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:34.314120 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:34.314262 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:34.314771 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:34.314776 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:34.315001 (+ 225us) client_negotiation.cc:769] Sending connection context
0806 02:21:34.315197 (+ 196us) client_negotiation.cc:240] Negotiation successful
0806 02:21:34.315463 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":179,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:21:34.317791 20371 heartbeater.cc:347] Connected to a master server at 127.26.189.190:38555
I20260806 02:21:34.318060 20371 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:34.318735 20371 heartbeater.cc:511] Master 127.26.189.190:38555 requested a full tablet report, sending...
I20260806 02:21:34.320509 20105 ts_manager.cc:194] Registered new tserver with Master: 2754c7dcfa9b44ddb03b55041e24b646 (127.26.189.129:45397)
I20260806 02:21:34.322309 20105 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:57857
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:21:34.334764 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:38555
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:34.451398 20376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:34.451660 20376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:34.451704 20376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:34.455727 20376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:34.455783 20376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:34.455840 20376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:21:34.461023 20376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:38555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:34.462124 20376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:34.463092 20376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:34.472903 20387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:34.472999 20384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:34.472892 20383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:34.473176 20376 server_base.cc:1034] running on GCE node
I20260806 02:21:34.473722 20376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:34.474350 20376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:34.475538 20376 hybrid_clock.cc:648] HybridClock initialized: now 1785982894475516 us; error 32 us; skew 500 ppm
Aug 06 02:21:34 dist-test-slave-gkw7 krb5kdc[20045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982894, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:34.478403 20376 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:21:34.479296 20376 webserver.cc:460] Webserver started at http://127.26.189.130:43029/ using document root <none> and password file <none>
I20260806 02:21:34.479867 20376 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:34.479930 20376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:34.480191 20376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:34.482394 20376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "6dc31a8d2dfc41a08660eb56f74eff5e"
format_stamp: "Formatted at 2026-08-06 02:21:34 on dist-test-slave-gkw7"
server_key: "2fda5dc87b21cf56912ddeacb79c7f20"
server_key_iv: "dfe545cb3503580801a7fbab7928aa2a"
server_key_version: "encryptionkey@0"
I20260806 02:21:34.482981 20376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "6dc31a8d2dfc41a08660eb56f74eff5e"
format_stamp: "Formatted at 2026-08-06 02:21:34 on dist-test-slave-gkw7"
server_key: "2fda5dc87b21cf56912ddeacb79c7f20"
server_key_iv: "dfe545cb3503580801a7fbab7928aa2a"
server_key_version: "encryptionkey@0"
I20260806 02:21:34.486853 20376 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:21:34.489418 20400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:34.490669 20376 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 02:21:34.490803 20376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "6dc31a8d2dfc41a08660eb56f74eff5e"
format_stamp: "Formatted at 2026-08-06 02:21:34 on dist-test-slave-gkw7"
server_key: "2fda5dc87b21cf56912ddeacb79c7f20"
server_key_iv: "dfe545cb3503580801a7fbab7928aa2a"
server_key_version: "encryptionkey@0"
I20260806 02:21:34.490911 20376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:34.529263 20376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:34.532897 20376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:34.533102 20376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:34.533772 20376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:34.534657 20376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:34.534725 20376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:34.534794 20376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:34.534839 20376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:34.543816 20376 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:33891
I20260806 02:21:34.543839 20570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:33891 every 8 connection(s)
I20260806 02:21:34.544746 20376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:21:34.552104 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 20376
I20260806 02:21:34.552259 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:21:34.552570 27382 external_mini_cluster.cc:1428] Setting key 05f077e2510be57cbb07f4869db6550a
Aug 06 02:21:34 dist-test-slave-gkw7 krb5kdc[20045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982894, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:21:34.560181 20157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.546589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:59253 (local address 127.26.189.190:38555)
0806 02:21:34.546722 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:34.546726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:34.547558 (+ 832us) server_negotiation.cc:407] Connection header received
0806 02:21:34.548923 (+ 1365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:34.548926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:34.548986 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:34.549082 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:34.550331 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.550870 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.552154 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.552482 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.552594 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.555976 (+ 3382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:34.555979 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:34.555981 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:34.556005 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:34.557813 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:34.558397 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:34.558404 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:34.558408 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:34.558506 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:34.558864 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:34.558871 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:34.558875 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:34.559136 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:34.559245 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:34.559777 (+ 532us) server_negotiation.cc:299] Negotiation successful
0806 02:21:34.559930 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 02:21:34.561023 20578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.546958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:38555 (local address 127.26.189.130:59253)
0806 02:21:34.547414 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:34.547457 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:34.548686 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:34.549254 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:34.549261 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:34.549685 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:34.550185 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.550198 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.551000 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.551003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.552030 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.552041 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.552644 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.552648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.552828 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.553606 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:21:34.553627 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:34.555801 (+ 2174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:34.557956 (+ 2155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:34.557962 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:34.557975 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:34.558275 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:34.558603 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:34.558614 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:34.558615 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:34.558759 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:34.559246 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:34.559252 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:34.559507 (+ 255us) client_negotiation.cc:769] Sending connection context
0806 02:21:34.559686 (+ 179us) client_negotiation.cc:240] Negotiation successful
0806 02:21:34.560049 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":125,"threads_started":1}
I20260806 02:21:34.562352 20573 heartbeater.cc:347] Connected to a master server at 127.26.189.190:38555
I20260806 02:21:34.562641 20573 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:34.563287 20573 heartbeater.cc:511] Master 127.26.189.190:38555 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
I20260806 02:21:34.564611 20105 ts_manager.cc:194] Registered new tserver with Master: 6dc31a8d2dfc41a08660eb56f74eff5e (127.26.189.130:33891)
I20260806 02:21:34.565264 20105 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:59253
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:21:34.584872 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:38555
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:34.700711 20582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:34.701014 20582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:34.701090 20582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:34.705159 20582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:34.705267 20582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:34.705361 20582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:21:34.710844 20582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:38555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:34.711951 20582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:34.713050 20582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:34.723026 20590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:34.723080 20589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:34.723194 20593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:34.723344 20582 server_base.cc:1034] running on GCE node
I20260806 02:21:34.723798 20582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:34.724444 20582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:34.725612 20582 hybrid_clock.cc:648] HybridClock initialized: now 1785982894725591 us; error 34 us; skew 500 ppm
Aug 06 02:21:34 dist-test-slave-gkw7 krb5kdc[20045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982894, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:34.728482 20582 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:21:34.729387 20582 webserver.cc:460] Webserver started at http://127.26.189.131:32843/ using document root <none> and password file <none>
I20260806 02:21:34.729991 20582 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:34.730054 20582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:34.730342 20582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:34.732612 20582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "a0848dade8ba4520aadb45855b784a60"
format_stamp: "Formatted at 2026-08-06 02:21:34 on dist-test-slave-gkw7"
server_key: "a0ab2014a4d6a43afea2fdc990a7f74d"
server_key_iv: "c336a99c6e65363233e4612b922a8d71"
server_key_version: "encryptionkey@0"
I20260806 02:21:34.733211 20582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "a0848dade8ba4520aadb45855b784a60"
format_stamp: "Formatted at 2026-08-06 02:21:34 on dist-test-slave-gkw7"
server_key: "a0ab2014a4d6a43afea2fdc990a7f74d"
server_key_iv: "c336a99c6e65363233e4612b922a8d71"
server_key_version: "encryptionkey@0"
I20260806 02:21:34.736974 20582 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 02:21:34.739454 20600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:34.740679 20582 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:34.740813 20582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "a0848dade8ba4520aadb45855b784a60"
format_stamp: "Formatted at 2026-08-06 02:21:34 on dist-test-slave-gkw7"
server_key: "a0ab2014a4d6a43afea2fdc990a7f74d"
server_key_iv: "c336a99c6e65363233e4612b922a8d71"
server_key_version: "encryptionkey@0"
I20260806 02:21:34.740922 20582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:34.762691 20582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:34.765745 20582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:34.765954 20582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:34.766572 20582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:34.767464 20582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:34.767529 20582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:34.767599 20582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:34.767639 20582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:34.776871 20582 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:44333
I20260806 02:21:34.776893 20774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:44333 every 8 connection(s)
I20260806 02:21:34.777837 20582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:21:34.782313 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 20582
I20260806 02:21:34.782481 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:21:34.782790 27382 external_mini_cluster.cc:1428] Setting key 8a810a3e8efc8e10d488d7e3ba8ddd67
Aug 06 02:21:34 dist-test-slave-gkw7 krb5kdc[20045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982894, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:21:34.792204 20157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.779749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:60317 (local address 127.26.189.190:38555)
0806 02:21:34.779908 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:34.779913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:34.780817 (+ 904us) server_negotiation.cc:407] Connection header received
0806 02:21:34.782198 (+ 1381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:34.782202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:34.782267 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:34.782363 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:34.783899 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.784580 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.786070 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.786289 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.786373 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.788815 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:34.788819 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:34.788821 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:34.788844 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:34.790197 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:34.790795 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:34.790798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:34.790799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:34.790874 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:34.791200 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:34.791202 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:34.791203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:34.791371 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:34.791446 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:34.791985 (+ 539us) server_negotiation.cc:299] Negotiation successful
0806 02:21:34.792084 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 02:21:34.793190 20777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.780181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:38555 (local address 127.26.189.131:60317)
0806 02:21:34.780649 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:34.780698 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:34.781933 (+ 1235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:34.782618 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:34.782625 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:34.783033 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:34.783755 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.783773 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.784732 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.784735 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.785952 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.785962 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.786427 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.786431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.786573 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.787153 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:21:34.787169 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:34.788654 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:34.790349 (+ 1695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:34.790354 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:34.790368 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:34.790690 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:34.790960 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:34.790962 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:34.790964 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:34.791111 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:34.791467 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:34.791473 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:34.791768 (+ 295us) client_negotiation.cc:769] Sending connection context
0806 02:21:34.791946 (+ 178us) client_negotiation.cc:240] Negotiation successful
0806 02:21:34.792236 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":124,"threads_started":1}
I20260806 02:21:34.794437 20775 heartbeater.cc:347] Connected to a master server at 127.26.189.190:38555
I20260806 02:21:34.794730 20775 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:34.795359 20775 heartbeater.cc:511] Master 127.26.189.190:38555 requested a full tablet report, sending...
I20260806 02:21:34.796667 20103 ts_manager.cc:194] Registered new tserver with Master: a0848dade8ba4520aadb45855b784a60 (127.26.189.131:44333)
I20260806 02:21:34.797272 20103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:60317
I20260806 02:21:34.808894 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:21:34.819090 20157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.811017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46892 (local address 127.26.189.190:38555)
0806 02:21:34.811138 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:34.811146 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:34.811402 (+ 256us) server_negotiation.cc:407] Connection header received
0806 02:21:34.811530 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:34.811532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:34.811575 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:34.811636 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:34.812456 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.812973 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.813914 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.814130 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.814209 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.815864 (+ 1655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:34.815867 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:34.815869 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:34.815890 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:34.817358 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:34.817927 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:34.817931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:34.817932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:34.818008 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:34.818336 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:34.818338 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:34.818340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:34.818541 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:34.818651 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:34.818888 (+ 237us) server_negotiation.cc:299] Negotiation successful
0806 02:21:34.818970 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 02:21:34.822177 20103 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:21:34.825218 20103 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:21:34.839982 20788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.833947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:44333 (local address 127.0.0.1:40494)
0806 02:21:34.834766 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:34.834819 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:34.834970 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:34.835767 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:34.835775 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:34.835800 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:34.835939 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.835946 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.837310 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.837316 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.838469 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.838478 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.839385 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.839388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.839517 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.839558 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 02:21:34.839690 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 02:21:34.839817 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"mutex_wait_us":24,"thread_start_us":83,"threads_started":1}
I20260806 02:21:34.840669 20790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.834144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40494 (local address 127.26.189.131:44333)
0806 02:21:34.835119 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:34.835137 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:34.835156 (+ 19us) server_negotiation.cc:407] Connection header received
0806 02:21:34.835219 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:34.835223 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:34.835420 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:34.835586 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:34.836065 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.837184 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.838611 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.839260 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.839400 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.839544 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:34.840402 (+ 858us) server_negotiation.cc:299] Negotiation successful
0806 02:21:34.840510 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":860,"thread_start_us":145,"threads_started":1}
I20260806 02:21:34.840994 20793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.834896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51628 (local address 127.26.189.130:33891)
0806 02:21:34.835258 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:34.835270 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:34.836438 (+ 1168us) server_negotiation.cc:407] Connection header received
0806 02:21:34.836534 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:34.836539 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:34.836737 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:34.836895 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:34.837115 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.838269 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.839695 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.840378 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.840525 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.840671 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:34.840753 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 02:21:34.840843 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":169,"threads_started":1}
I20260806 02:21:34.841357 20789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.834158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:45397 (local address 127.0.0.1:52932)
0806 02:21:34.836130 (+ 1972us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:34.836140 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:34.836211 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:34.836651 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:34.836653 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:34.836670 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:34.836774 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.836780 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.838205 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.838208 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.839534 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.839546 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.840949 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.840952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.841017 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.841033 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 02:21:34.841135 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 02:21:34.841204 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1920,"mutex_wait_us":32,"thread_start_us":116,"threads_started":1}
I20260806 02:21:34.841833 20792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.834730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52932 (local address 127.26.189.129:45397)
0806 02:21:34.835483 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:34.835488 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:34.836226 (+ 738us) server_negotiation.cc:407] Connection header received
0806 02:21:34.836317 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:34.836323 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:34.836516 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:34.836657 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:34.836913 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.838074 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.839671 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.840584 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.840716 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.840882 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:34.841567 (+ 685us) server_negotiation.cc:299] Negotiation successful
0806 02:21:34.841675 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":674,"thread_start_us":109,"threads_started":1}
I20260806 02:21:34.841851 20791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.834349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:33891 (local address 127.0.0.1:51628)
0806 02:21:34.836331 (+ 1982us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:34.836340 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:34.836436 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:34.836882 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:34.836885 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:34.836903 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:34.836999 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.837004 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.838408 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.838411 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.839568 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.839577 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.840511 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.840515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.840620 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.840642 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 02:21:34.840723 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 02:21:34.841705 (+ 982us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1944,"mutex_wait_us":28,"thread_start_us":99,"threads_started":1}
I20260806 02:21:34.844040 20665 tablet_service.cc:1467] Processing CreateTablet for tablet b6a176e04c8f40e4a01488ac822b2ccd (DEFAULT_TABLE table=test-table [id=1fa02aee3b684c1e86b62abdeb00d15a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:34.844484 20269 tablet_service.cc:1467] Processing CreateTablet for tablet b6a176e04c8f40e4a01488ac822b2ccd (DEFAULT_TABLE table=test-table [id=1fa02aee3b684c1e86b62abdeb00d15a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:34.844851 20471 tablet_service.cc:1467] Processing CreateTablet for tablet b6a176e04c8f40e4a01488ac822b2ccd (DEFAULT_TABLE table=test-table [id=1fa02aee3b684c1e86b62abdeb00d15a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:34.845265 20665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6a176e04c8f40e4a01488ac822b2ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:34.845573 20269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6a176e04c8f40e4a01488ac822b2ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:34.845834 20471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6a176e04c8f40e4a01488ac822b2ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:34.851522 20794 tablet_bootstrap.cc:492] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646: Bootstrap starting.
I20260806 02:21:34.852988 20795 tablet_bootstrap.cc:492] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60: Bootstrap starting.
I20260806 02:21:34.853845 20796 tablet_bootstrap.cc:492] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e: Bootstrap starting.
I20260806 02:21:34.854916 20794 tablet_bootstrap.cc:654] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:34.855165 20795 tablet_bootstrap.cc:654] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:34.855803 20796 tablet_bootstrap.cc:654] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:34.855973 20794 log.cc:824] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:34.856501 20795 log.cc:824] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:34.857077 20796 log.cc:824] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:34.858206 20794 tablet_bootstrap.cc:492] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646: No bootstrap required, opened a new log
I20260806 02:21:34.858414 20794 ts_tablet_manager.cc:1397] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 02:21:34.858500 20795 tablet_bootstrap.cc:492] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60: No bootstrap required, opened a new log
I20260806 02:21:34.858685 20795 ts_tablet_manager.cc:1397] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 02:21:34.858835 20796 tablet_bootstrap.cc:492] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e: No bootstrap required, opened a new log
I20260806 02:21:34.859019 20796 ts_tablet_manager.cc:1397] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 02:21:34.862246 20796 raft_consensus.cc:348] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0848dade8ba4520aadb45855b784a60" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44333 } } peers { permanent_uuid: "2754c7dcfa9b44ddb03b55041e24b646" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45397 } } peers { permanent_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33891 } }
I20260806 02:21:34.862495 20796 raft_consensus.cc:374] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:34.862568 20796 raft_consensus.cc:729] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dc31a8d2dfc41a08660eb56f74eff5e, State: Initialized, Role: FOLLOWER
I20260806 02:21:34.862640 20795 raft_consensus.cc:348] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0848dade8ba4520aadb45855b784a60" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44333 } } peers { permanent_uuid: "2754c7dcfa9b44ddb03b55041e24b646" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45397 } } peers { permanent_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33891 } }
I20260806 02:21:34.862902 20795 raft_consensus.cc:374] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:34.862964 20795 raft_consensus.cc:729] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0848dade8ba4520aadb45855b784a60, State: Initialized, Role: FOLLOWER
I20260806 02:21:34.863075 20796 consensus_queue.cc:260] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0848dade8ba4520aadb45855b784a60" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44333 } } peers { permanent_uuid: "2754c7dcfa9b44ddb03b55041e24b646" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45397 } } peers { permanent_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33891 } }
I20260806 02:21:34.863394 20795 consensus_queue.cc:260] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0848dade8ba4520aadb45855b784a60" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44333 } } peers { permanent_uuid: "2754c7dcfa9b44ddb03b55041e24b646" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45397 } } peers { permanent_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33891 } }
I20260806 02:21:34.863339 20794 raft_consensus.cc:348] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0848dade8ba4520aadb45855b784a60" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44333 } } peers { permanent_uuid: "2754c7dcfa9b44ddb03b55041e24b646" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45397 } } peers { permanent_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33891 } }
I20260806 02:21:34.863754 20794 raft_consensus.cc:374] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:34.863799 20573 heartbeater.cc:503] Master 127.26.189.190:38555 was elected leader, sending a full tablet report...
I20260806 02:21:34.863893 20794 raft_consensus.cc:729] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2754c7dcfa9b44ddb03b55041e24b646, State: Initialized, Role: FOLLOWER
I20260806 02:21:34.864138 20796 ts_tablet_manager.cc:1428] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 02:21:34.864461 20795 ts_tablet_manager.cc:1428] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:21:34.864365 20794 consensus_queue.cc:260] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0848dade8ba4520aadb45855b784a60" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44333 } } peers { permanent_uuid: "2754c7dcfa9b44ddb03b55041e24b646" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45397 } } peers { permanent_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33891 } }
I20260806 02:21:34.864820 20775 heartbeater.cc:503] Master 127.26.189.190:38555 was elected leader, sending a full tablet report...
I20260806 02:21:34.865237 20794 ts_tablet_manager.cc:1428] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 02:21:34.865593 20371 heartbeater.cc:503] Master 127.26.189.190:38555 was elected leader, sending a full tablet report...
I20260806 02:21:34.874816 20802 raft_consensus.cc:482] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:21:34.874991 20802 raft_consensus.cc:504] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0848dade8ba4520aadb45855b784a60" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44333 } } peers { permanent_uuid: "2754c7dcfa9b44ddb03b55041e24b646" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45397 } } peers { permanent_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33891 } }
I20260806 02:21:34.876170 20802 leader_election.cc:288] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0848dade8ba4520aadb45855b784a60 (127.26.189.131:44333), 6dc31a8d2dfc41a08660eb56f74eff5e (127.26.189.130:33891)
I20260806 02:21:34.881950 20793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.876641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:42643 (local address 127.26.189.130:33891)
0806 02:21:34.876843 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:34.876850 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:34.876939 (+ 89us) server_negotiation.cc:407] Connection header received
0806 02:21:34.877177 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:34.877181 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:34.877237 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:34.877318 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:34.877843 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.878633 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.880479 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.881135 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.881276 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.881326 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:34.881746 (+ 420us) server_negotiation.cc:299] Negotiation successful
0806 02:21:34.881837 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260806 02:21:34.881950 20790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.876835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:34441 (local address 127.26.189.131:44333)
0806 02:21:34.876956 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:34.876960 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:34.877085 (+ 125us) server_negotiation.cc:407] Connection header received
0806 02:21:34.877189 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:34.877191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:34.877234 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:34.877316 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:34.877843 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.878633 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.880479 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.881131 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.881268 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.881326 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:34.881709 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 02:21:34.881816 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 02:21:34.882004 20803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.876403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:33891 (local address 127.26.189.129:42643)
0806 02:21:34.876840 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:34.876855 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:34.877034 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:34.877379 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:34.877383 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:34.877428 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:34.877713 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.877721 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.878773 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.878776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.880333 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.880346 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.881267 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.881271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.881474 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.881594 (+ 120us) client_negotiation.cc:769] Sending connection context
0806 02:21:34.881711 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 02:21:34.881774 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":258,"spinlock_wait_cycles":36864,"thread_start_us":160,"threads_started":1}
I20260806 02:21:34.882005 20804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.876409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:44333 (local address 127.26.189.129:34441)
0806 02:21:34.876996 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:34.877008 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:34.877111 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:34.877379 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:34.877383 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:34.877429 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:34.877713 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.877721 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.878773 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.878776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.880344 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:34.880351 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.881267 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.881271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:34.881489 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.881594 (+ 105us) client_negotiation.cc:769] Sending connection context
0806 02:21:34.881677 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 02:21:34.881765 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":324,"spinlock_wait_cycles":19456,"thread_start_us":140,"threads_started":1}
I20260806 02:21:34.882758 20506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6a176e04c8f40e4a01488ac822b2ccd" candidate_uuid: "2754c7dcfa9b44ddb03b55041e24b646" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e" is_pre_election: true
I20260806 02:21:34.882755 20699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6a176e04c8f40e4a01488ac822b2ccd" candidate_uuid: "2754c7dcfa9b44ddb03b55041e24b646" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0848dade8ba4520aadb45855b784a60" is_pre_election: true
I20260806 02:21:34.883059 20699 raft_consensus.cc:2454] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2754c7dcfa9b44ddb03b55041e24b646 in term 0.
I20260806 02:21:34.883065 20506 raft_consensus.cc:2454] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2754c7dcfa9b44ddb03b55041e24b646 in term 0.
I20260806 02:21:34.883587 20209 leader_election.cc:302] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2754c7dcfa9b44ddb03b55041e24b646, 6dc31a8d2dfc41a08660eb56f74eff5e, a0848dade8ba4520aadb45855b784a60; no voters:
I20260806 02:21:34.883890 20802 raft_consensus.cc:2781] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:21:34.883966 20802 raft_consensus.cc:482] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:21:34.884013 20802 raft_consensus.cc:3037] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:34.885110 20802 raft_consensus.cc:504] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0848dade8ba4520aadb45855b784a60" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44333 } } peers { permanent_uuid: "2754c7dcfa9b44ddb03b55041e24b646" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45397 } } peers { permanent_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33891 } }
I20260806 02:21:34.885496 20802 leader_election.cc:288] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [CANDIDATE]: Term 1 election: Requested vote from peers a0848dade8ba4520aadb45855b784a60 (127.26.189.131:44333), 6dc31a8d2dfc41a08660eb56f74eff5e (127.26.189.130:33891)
I20260806 02:21:34.885897 20506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6a176e04c8f40e4a01488ac822b2ccd" candidate_uuid: "2754c7dcfa9b44ddb03b55041e24b646" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e"
I20260806 02:21:34.886011 20506 raft_consensus.cc:3037] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:34.887284 20506 raft_consensus.cc:2454] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2754c7dcfa9b44ddb03b55041e24b646 in term 1.
I20260806 02:21:34.887563 20699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6a176e04c8f40e4a01488ac822b2ccd" candidate_uuid: "2754c7dcfa9b44ddb03b55041e24b646" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0848dade8ba4520aadb45855b784a60"
I20260806 02:21:34.887626 20213 leader_election.cc:302] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2754c7dcfa9b44ddb03b55041e24b646, 6dc31a8d2dfc41a08660eb56f74eff5e; no voters:
I20260806 02:21:34.887709 20699 raft_consensus.cc:3037] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:34.887812 20802 raft_consensus.cc:2781] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:34.888046 20802 raft_consensus.cc:686] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [term 1 LEADER]: Becoming Leader. State: Replica: 2754c7dcfa9b44ddb03b55041e24b646, State: Running, Role: LEADER
I20260806 02:21:34.888423 20802 consensus_queue.cc:237] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0848dade8ba4520aadb45855b784a60" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44333 } } peers { permanent_uuid: "2754c7dcfa9b44ddb03b55041e24b646" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45397 } } peers { permanent_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33891 } }
I20260806 02:21:34.888948 20699 raft_consensus.cc:2454] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2754c7dcfa9b44ddb03b55041e24b646 in term 1.
I20260806 02:21:34.891846 20103 catalog_manager.cc:5495] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2754c7dcfa9b44ddb03b55041e24b646 (127.26.189.129). New cstate: current_term: 1 leader_uuid: "2754c7dcfa9b44ddb03b55041e24b646" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0848dade8ba4520aadb45855b784a60" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2754c7dcfa9b44ddb03b55041e24b646" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 45397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33891 } health_report { overall_health: UNKNOWN } } }
I20260806 02:21:34.908198 20792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.904575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52942 (local address 127.26.189.129:45397)
0806 02:21:34.904717 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:34.904721 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:34.904736 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:21:34.904868 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:34.904870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:34.904927 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:34.905020 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:21:34.905238 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.905828 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.906756 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:34.906967 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:34.907043 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:34.907382 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:21:34.907799 (+ 417us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:21:34.907910 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:34.908051 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 02:21:34.908089 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 02:21:34.914570 20699 raft_consensus.cc:1261] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60 [term 1 FOLLOWER]: Refusing update from remote peer 2754c7dcfa9b44ddb03b55041e24b646: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:21:34.914572 20506 raft_consensus.cc:1261] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e [term 1 FOLLOWER]: Refusing update from remote peer 2754c7dcfa9b44ddb03b55041e24b646: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:21:34.915334 20805 consensus_queue.cc:1035] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dc31a8d2dfc41a08660eb56f74eff5e" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 33891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:21:34.915568 20802 consensus_queue.cc:1035] T b6a176e04c8f40e4a01488ac822b2ccd P 2754c7dcfa9b44ddb03b55041e24b646 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0848dade8ba4520aadb45855b784a60" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:21:34.922912 20809 mvcc.cc:205] Tried to move back new op lower bound from 7315385937562615808 to 7315385937466159104. Current Snapshot: MvccSnapshot[applied={T|T < 7315385937562615808}]
I20260806 02:21:34.932453 20105 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:21:34.932678 20105 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:21:34.935322 20105 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e3de985c6c8d4fb1983aa1d37c8e49f7: Sending DeleteTablet for 3 replicas of tablet b6a176e04c8f40e4a01488ac822b2ccd
I20260806 02:21:34.936129 20665 tablet_service.cc:1514] Processing DeleteTablet for tablet b6a176e04c8f40e4a01488ac822b2ccd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:34 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:40494
I20260806 02:21:34.936141 20269 tablet_service.cc:1514] Processing DeleteTablet for tablet b6a176e04c8f40e4a01488ac822b2ccd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:34 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:52932
I20260806 02:21:34.937026 20822 tablet_replica.cc:330] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60: stopping tablet replica
I20260806 02:21:34.937047 20471 tablet_service.cc:1514] Processing DeleteTablet for tablet b6a176e04c8f40e4a01488ac822b2ccd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:34 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:51628
I20260806 02:21:34.937166 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 20186
I20260806 02:21:34.937422 20822 raft_consensus.cc:2229] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:21:34.944891 20822 raft_consensus.cc:2258] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:34.946924 20822 ts_tablet_manager.cc:1905] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:21:34.949931 20823 tablet_replica.cc:330] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e: stopping tablet replica
I20260806 02:21:34.950338 20823 raft_consensus.cc:2229] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:21:34.950706 20823 raft_consensus.cc:2258] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:34.950728 20822 ts_tablet_manager.cc:1918] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:21:34.950906 20822 log.cc:1196] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/b6a176e04c8f40e4a01488ac822b2ccd
I20260806 02:21:34.951298 20822 ts_tablet_manager.cc:1939] T b6a176e04c8f40e4a01488ac822b2ccd P a0848dade8ba4520aadb45855b784a60: Deleting consensus metadata
I20260806 02:21:34.952454 20823 ts_tablet_manager.cc:1905] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:21:34.952769 20086 catalog_manager.cc:4841] TS a0848dade8ba4520aadb45855b784a60 (127.26.189.131:44333): tablet b6a176e04c8f40e4a01488ac822b2ccd (table test-table [id=1fa02aee3b684c1e86b62abdeb00d15a]) successfully deleted
W20260806 02:21:34.954998 20088 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:45397 (error 108)
I20260806 02:21:34.955040 20823 ts_tablet_manager.cc:1918] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:21:34.955147 20823 log.cc:1196] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/b6a176e04c8f40e4a01488ac822b2ccd
I20260806 02:21:34.955579 20823 ts_tablet_manager.cc:1939] T b6a176e04c8f40e4a01488ac822b2ccd P 6dc31a8d2dfc41a08660eb56f74eff5e: Deleting consensus metadata
I20260806 02:21:34.956153 20791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.955837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:45397 (local address 127.0.0.1:52952)
0806 02:21:34.955983 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:34.956063 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:45397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 02:21:34.956223 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 20376
W20260806 02:21:34.956377 20088 catalog_manager.cc:4584] TS 2754c7dcfa9b44ddb03b55041e24b646 (127.26.189.129:45397): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b6a176e04c8f40e4a01488ac822b2ccd: Network error: Client connection negotiation failed: client connection to 127.26.189.129:45397: connect: Connection refused (error 111)
I20260806 02:21:34.968071 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 20582
I20260806 02:21:34.971489 20791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:34.968343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:33891 (local address 127.0.0.1:51636)
0806 02:21:34.971306 (+ 2963us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:34.971374 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.130:33891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2844}
I20260806 02:21:34.983386 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 20062
2026-08-06T02:21:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2536 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T02:21:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:35Z Disabled control of system clock
I20260806 02:21:35.022704 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:32841
--webserver_interface=127.26.189.190
--webserver_port=0
--builtin_ntp_servers=127.26.189.148:34879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:32841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 02:21:35.138551 20828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:35.138809 20828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:35.138845 20828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:35.142803 20828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:35.142855 20828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:35.142871 20828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:35.142887 20828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:35.142930 20828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:35.147589 20828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:32841
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:32841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:35.148703 20828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:35.150135 20828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:35.158586 20833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:35.158586 20835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:35.158601 20837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:35.159232 20828 server_base.cc:1034] running on GCE node
I20260806 02:21:35.159749 20828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:35.160862 20828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:35.162024 20828 hybrid_clock.cc:648] HybridClock initialized: now 1785982895162008 us; error 36 us; skew 500 ppm
I20260806 02:21:35.163841 20828 webserver.cc:460] Webserver started at http://127.26.189.190:41529/ using document root <none> and password file <none>
I20260806 02:21:35.164387 20828 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:35.164449 20828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:35.164618 20828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:35.166705 20828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "698e3f6718a3470d8cb9a332e529df29"
format_stamp: "Formatted at 2026-08-06 02:21:35 on dist-test-slave-gkw7"
server_key: "cd1ea67dc247c7cc22edd5053d90e451"
server_key_iv: "b7f975130d36f3ea79dff0ee6fb8d00f"
server_key_version: "encryptionkey@0"
I20260806 02:21:35.167233 20828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "698e3f6718a3470d8cb9a332e529df29"
format_stamp: "Formatted at 2026-08-06 02:21:35 on dist-test-slave-gkw7"
server_key: "cd1ea67dc247c7cc22edd5053d90e451"
server_key_iv: "b7f975130d36f3ea79dff0ee6fb8d00f"
server_key_version: "encryptionkey@0"
I20260806 02:21:35.170969 20828 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:21:35.173409 20846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:35.174731 20828 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:21:35.174831 20828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "698e3f6718a3470d8cb9a332e529df29"
format_stamp: "Formatted at 2026-08-06 02:21:35 on dist-test-slave-gkw7"
server_key: "cd1ea67dc247c7cc22edd5053d90e451"
server_key_iv: "b7f975130d36f3ea79dff0ee6fb8d00f"
server_key_version: "encryptionkey@0"
I20260806 02:21:35.174917 20828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:35.187822 20828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:35.188490 20828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:35.188644 20828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:35.195986 20828 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:32841
I20260806 02:21:35.195997 20934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:32841 every 8 connection(s)
I20260806 02:21:35.197011 20828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:35.199172 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 20828
I20260806 02:21:35.199309 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:35.199611 27382 external_mini_cluster.cc:1428] Setting key e7348c57e86dede608c7ff2f17bace7b
I20260806 02:21:35.200488 20935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:35.206645 20935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29: Bootstrap starting.
I20260806 02:21:35.208999 20935 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:35.209024 20940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.201054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46526 (local address 127.26.189.190:32841)
0806 02:21:35.201805 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:35.201823 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:35.201861 (+ 38us) server_negotiation.cc:407] Connection header received
0806 02:21:35.202550 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:35.202569 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:35.202963 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:35.203335 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:35.203766 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.204736 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.205698 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.206184 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.206353 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.207301 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:35.207306 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:35.207319 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:35.207715 (+ 396us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:35.207772 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:35.207792 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:35.207901 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:35.208021 (+ 120us) server_negotiation.cc:299] Negotiation successful
0806 02:21:35.208287 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":168,"threads_started":1}
I20260806 02:21:35.210043 20935 log.cc:824] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:35.212031 20935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29: No bootstrap required, opened a new log
I20260806 02:21:35.215734 20935 raft_consensus.cc:348] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "698e3f6718a3470d8cb9a332e529df29" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 32841 } }
I20260806 02:21:35.215958 20935 raft_consensus.cc:374] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:35.216038 20935 raft_consensus.cc:729] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 698e3f6718a3470d8cb9a332e529df29, State: Initialized, Role: FOLLOWER
I20260806 02:21:35.216473 20935 consensus_queue.cc:260] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "698e3f6718a3470d8cb9a332e529df29" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 32841 } }
I20260806 02:21:35.216598 20935 raft_consensus.cc:388] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:35.216663 20935 raft_consensus.cc:482] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:35.216784 20935 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:35.217777 20935 raft_consensus.cc:504] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "698e3f6718a3470d8cb9a332e529df29" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 32841 } }
I20260806 02:21:35.218129 20935 leader_election.cc:302] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 698e3f6718a3470d8cb9a332e529df29; no voters:
I20260806 02:21:35.218449 20935 leader_election.cc:288] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:35.218600 20943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:35.218838 20943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [term 1 LEADER]: Becoming Leader. State: Replica: 698e3f6718a3470d8cb9a332e529df29, State: Running, Role: LEADER
I20260806 02:21:35.219178 20943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "698e3f6718a3470d8cb9a332e529df29" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 32841 } }
I20260806 02:21:35.219713 20935 sys_catalog.cc:564] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:35.221009 20945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 698e3f6718a3470d8cb9a332e529df29. Latest consensus state: current_term: 1 leader_uuid: "698e3f6718a3470d8cb9a332e529df29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "698e3f6718a3470d8cb9a332e529df29" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 32841 } } }
I20260806 02:21:35.221151 20945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:35.221513 20944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "698e3f6718a3470d8cb9a332e529df29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "698e3f6718a3470d8cb9a332e529df29" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 32841 } } }
I20260806 02:21:35.221696 20944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:35.221603 20957 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:35.224687 20957 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:35.230754 20957 catalog_manager.cc:1347] Generated new cluster ID: ddf590b18b32411e868e2f85c23513b2
I20260806 02:21:35.230847 20957 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:35.243280 20957 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:35.244313 20957 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:35.257030 20957 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29: Generated new TSK 0
I20260806 02:21:35.257812 20957 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:35.268218 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:32841
--builtin_ntp_servers=127.26.189.148:34879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 02:21:35.388095 20968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:35.388391 20968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:35.388432 20968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:35.392537 20968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:35.392604 20968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:35.392663 20968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:21:35.397982 20968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:32841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:35.399224 20968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:35.400723 20968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:35.410872 20978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:35.410876 20975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:35.410909 20976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:35.411011 20968 server_base.cc:1034] running on GCE node
I20260806 02:21:35.411648 20968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:35.412349 20968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:35.413640 20968 hybrid_clock.cc:648] HybridClock initialized: now 1785982895413597 us; error 47 us; skew 500 ppm
I20260806 02:21:35.415659 20968 webserver.cc:460] Webserver started at http://127.26.189.129:40843/ using document root <none> and password file <none>
I20260806 02:21:35.416265 20968 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:35.416361 20968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:35.416605 20968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:35.418781 20968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "2a33449566694187b10881e5e0a2e6ab"
format_stamp: "Formatted at 2026-08-06 02:21:35 on dist-test-slave-gkw7"
server_key: "af73e316881a75d7a4c6e5945f02a408"
server_key_iv: "0e5022eb3209539f9c77e957e45017ef"
server_key_version: "encryptionkey@0"
I20260806 02:21:35.419378 20968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "2a33449566694187b10881e5e0a2e6ab"
format_stamp: "Formatted at 2026-08-06 02:21:35 on dist-test-slave-gkw7"
server_key: "af73e316881a75d7a4c6e5945f02a408"
server_key_iv: "0e5022eb3209539f9c77e957e45017ef"
server_key_version: "encryptionkey@0"
I20260806 02:21:35.423588 20968 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:21:35.426142 20986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:35.427449 20968 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:21:35.427605 20968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "2a33449566694187b10881e5e0a2e6ab"
format_stamp: "Formatted at 2026-08-06 02:21:35 on dist-test-slave-gkw7"
server_key: "af73e316881a75d7a4c6e5945f02a408"
server_key_iv: "0e5022eb3209539f9c77e957e45017ef"
server_key_version: "encryptionkey@0"
I20260806 02:21:35.427721 20968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:35.438256 20968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:35.438925 20968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:35.439119 20968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:35.439700 20968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:35.440837 20968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:35.440913 20968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:35.440981 20968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:35.441027 20968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:35.449784 20968 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:37481
I20260806 02:21:35.449806 21152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:37481 every 8 connection(s)
I20260806 02:21:35.450749 20968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:21:35.455796 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 20968
I20260806 02:21:35.455953 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:21:35.456240 27382 external_mini_cluster.cc:1428] Setting key 8559c93ca2305ffd8eeccfbe75288e22
I20260806 02:21:35.458184 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:32841
--builtin_ntp_servers=127.26.189.148:34879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 02:21:35.460430 20940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.452584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:48587 (local address 127.26.189.190:32841)
0806 02:21:35.452766 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:35.452771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:35.453894 (+ 1123us) server_negotiation.cc:407] Connection header received
0806 02:21:35.455304 (+ 1410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:35.455307 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:35.455358 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:35.455432 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:35.456457 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.457091 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.458286 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.458531 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.458643 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.459781 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:35.459784 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:35.459786 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:35.459798 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:35.459835 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:35.459849 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:35.459930 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:35.460150 (+ 220us) server_negotiation.cc:299] Negotiation successful
0806 02:21:35.460236 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 02:21:35.461177 21156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.453011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:32841 (local address 127.26.189.129:48587)
0806 02:21:35.453754 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:35.453796 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:35.455084 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:35.455597 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:35.455604 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:35.455687 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:35.456293 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:35.456325 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.457226 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.457230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:35.458156 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:35.458166 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.458686 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.458690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:35.458866 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.459520 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:21:35.459521 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:35.459561 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:21:35.459622 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:35.459966 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:35.459981 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:35.459988 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 02:21:35.460130 (+ 142us) client_negotiation.cc:240] Negotiation successful
0806 02:21:35.460363 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":123,"threads_started":1}
I20260806 02:21:35.462436 21153 heartbeater.cc:347] Connected to a master server at 127.26.189.190:32841
I20260806 02:21:35.462671 21153 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:35.463224 21153 heartbeater.cc:511] Master 127.26.189.190:32841 requested a full tablet report, sending...
I20260806 02:21:35.464694 20875 ts_manager.cc:194] Registered new tserver with Master: 2a33449566694187b10881e5e0a2e6ab (127.26.189.129:37481)
I20260806 02:21:35.465884 20875 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.189.129:48587
W20260806 02:21:35.577399 21157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:35.577690 21157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:35.577807 21157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:35.581893 21157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:35.581948 21157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:35.582056 21157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:21:35.586755 21157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:32841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:35.587875 21157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:35.589347 21157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:35.599272 21169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:35.599344 21163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:35.599319 21157 server_base.cc:1034] running on GCE node
W20260806 02:21:35.599519 21167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:35.599932 21157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:35.600566 21157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:35.601727 21157 hybrid_clock.cc:648] HybridClock initialized: now 1785982895601712 us; error 28 us; skew 500 ppm
I20260806 02:21:35.603615 21157 webserver.cc:460] Webserver started at http://127.26.189.130:33829/ using document root <none> and password file <none>
I20260806 02:21:35.604241 21157 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:35.604313 21157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:35.604524 21157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:35.606715 21157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "ec4dcc4721624500805db1967321e5f5"
format_stamp: "Formatted at 2026-08-06 02:21:35 on dist-test-slave-gkw7"
server_key: "a3ae15d04ee8cc8ae356a0d868cdc1c3"
server_key_iv: "b573080d9d847b4c2d4aafe4882fda21"
server_key_version: "encryptionkey@0"
I20260806 02:21:35.607309 21157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "ec4dcc4721624500805db1967321e5f5"
format_stamp: "Formatted at 2026-08-06 02:21:35 on dist-test-slave-gkw7"
server_key: "a3ae15d04ee8cc8ae356a0d868cdc1c3"
server_key_iv: "b573080d9d847b4c2d4aafe4882fda21"
server_key_version: "encryptionkey@0"
I20260806 02:21:35.611099 21157 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:21:35.613632 21177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:35.614904 21157 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:35.615044 21157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "ec4dcc4721624500805db1967321e5f5"
format_stamp: "Formatted at 2026-08-06 02:21:35 on dist-test-slave-gkw7"
server_key: "a3ae15d04ee8cc8ae356a0d868cdc1c3"
server_key_iv: "b573080d9d847b4c2d4aafe4882fda21"
server_key_version: "encryptionkey@0"
I20260806 02:21:35.615159 21157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:35.645278 21157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:35.646149 21157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:35.646377 21157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:35.647011 21157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:35.647989 21157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:35.648059 21157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:35.648133 21157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:35.648175 21157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:35.657436 21157 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:45571
I20260806 02:21:35.657465 21337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:45571 every 8 connection(s)
I20260806 02:21:35.658393 21157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:21:35.666474 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 21157
I20260806 02:21:35.666627 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:21:35.666965 27382 external_mini_cluster.cc:1428] Setting key 89843ffa64c2e6a0c97c8af242e7ebe9
I20260806 02:21:35.667654 20940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.660338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:59301 (local address 127.26.189.190:32841)
0806 02:21:35.660490 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:35.660494 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:35.661575 (+ 1081us) server_negotiation.cc:407] Connection header received
0806 02:21:35.662970 (+ 1395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:35.662973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:35.663021 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:35.663096 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:35.663985 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.664513 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.665689 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.665915 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.665994 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.667160 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:35.667164 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:35.667167 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:35.667181 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:35.667205 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:35.667216 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:35.667294 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:35.667455 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 02:21:35.667516 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 02:21:35.668668 21340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.660732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:32841 (local address 127.26.189.130:59301)
0806 02:21:35.661405 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:35.661446 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:35.662785 (+ 1339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:35.663295 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:35.663302 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:35.663385 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:35.663866 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:35.663878 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.664643 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.664646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:35.665589 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:35.665599 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.666044 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.666047 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:35.666216 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.666874 (+ 658us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:21:35.666875 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:35.666915 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:21:35.666978 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:35.667300 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:35.667308 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:35.667313 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 02:21:35.667444 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 02:21:35.667750 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":100,"threads_started":1}
I20260806 02:21:35.669001 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:32841
--builtin_ntp_servers=127.26.189.148:34879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 02:21:35.669873 21338 heartbeater.cc:347] Connected to a master server at 127.26.189.190:32841
I20260806 02:21:35.670127 21338 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:35.670764 21338 heartbeater.cc:511] Master 127.26.189.190:32841 requested a full tablet report, sending...
I20260806 02:21:35.671963 20875 ts_manager.cc:194] Registered new tserver with Master: ec4dcc4721624500805db1967321e5f5 (127.26.189.130:45571)
I20260806 02:21:35.672679 20875 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.189.130:59301
W20260806 02:21:35.784438 21341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:35.784741 21341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:35.784806 21341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:35.788857 21341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:35.788938 21341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:35.789027 21341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:21:35.793754 21341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:32841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:35.794858 21341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:35.796314 21341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:35.805974 21352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:35.805967 21348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:35.806102 21349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:35.806219 21341 server_base.cc:1034] running on GCE node
I20260806 02:21:35.806737 21341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:35.807420 21341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:35.808617 21341 hybrid_clock.cc:648] HybridClock initialized: now 1785982895808602 us; error 31 us; skew 500 ppm
I20260806 02:21:35.810469 21341 webserver.cc:460] Webserver started at http://127.26.189.131:33779/ using document root <none> and password file <none>
I20260806 02:21:35.811141 21341 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:35.811232 21341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:35.811456 21341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:35.813714 21341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "3bc0901affb1487dabc21a65c28aa6aa"
format_stamp: "Formatted at 2026-08-06 02:21:35 on dist-test-slave-gkw7"
server_key: "5bdac392bb8a5549028f3bb95bb53b2c"
server_key_iv: "8e6106b9b1b90b37cbd58738d5e3f617"
server_key_version: "encryptionkey@0"
I20260806 02:21:35.814275 21341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "3bc0901affb1487dabc21a65c28aa6aa"
format_stamp: "Formatted at 2026-08-06 02:21:35 on dist-test-slave-gkw7"
server_key: "5bdac392bb8a5549028f3bb95bb53b2c"
server_key_iv: "8e6106b9b1b90b37cbd58738d5e3f617"
server_key_version: "encryptionkey@0"
I20260806 02:21:35.818143 21341 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 02:21:35.820828 21360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:35.822295 21341 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:21:35.822428 21341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "3bc0901affb1487dabc21a65c28aa6aa"
format_stamp: "Formatted at 2026-08-06 02:21:35 on dist-test-slave-gkw7"
server_key: "5bdac392bb8a5549028f3bb95bb53b2c"
server_key_iv: "8e6106b9b1b90b37cbd58738d5e3f617"
server_key_version: "encryptionkey@0"
I20260806 02:21:35.822543 21341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:35.837039 21341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:35.837783 21341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:35.837970 21341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:35.838559 21341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:35.839517 21341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:35.839587 21341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:35.839671 21341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:35.839716 21341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:35.848397 21341 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:37995
I20260806 02:21:35.848419 21524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:37995 every 8 connection(s)
I20260806 02:21:35.849330 21341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:21:35.857257 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 21341
I20260806 02:21:35.857422 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:21:35.857810 27382 external_mini_cluster.cc:1428] Setting key 71f0e9b891a07f6328a51193719f1106
I20260806 02:21:35.858629 20940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.851185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:52657 (local address 127.26.189.190:32841)
0806 02:21:35.851331 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:35.851335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:35.852386 (+ 1051us) server_negotiation.cc:407] Connection header received
0806 02:21:35.853839 (+ 1453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:35.853842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:35.853900 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:35.854003 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:35.854892 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.855429 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.856572 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.856805 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.856912 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.858133 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:35.858136 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:35.858139 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:35.858152 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:35.858177 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:35.858185 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:35.858255 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:35.858424 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 02:21:35.858487 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 02:21:35.859515 21529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.851616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:32841 (local address 127.26.189.131:52657)
0806 02:21:35.852244 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:35.852290 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:35.853633 (+ 1343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:35.854171 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:35.854178 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:35.854267 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:35.854746 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:35.854760 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.855560 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.855564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:35.856443 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:35.856451 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.856986 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.856993 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:35.857142 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.857870 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:21:35.857872 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:35.857927 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:21:35.857988 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:35.858286 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:35.858299 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:35.858303 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 02:21:35.858421 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 02:21:35.858692 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":113,"threads_started":1}
I20260806 02:21:35.860488 21525 heartbeater.cc:347] Connected to a master server at 127.26.189.190:32841
I20260806 02:21:35.860724 21525 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:35.861270 21525 heartbeater.cc:511] Master 127.26.189.190:32841 requested a full tablet report, sending...
I20260806 02:21:35.862370 20875 ts_manager.cc:194] Registered new tserver with Master: 3bc0901affb1487dabc21a65c28aa6aa (127.26.189.131:37995)
I20260806 02:21:35.862939 20875 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.189.131:52657
I20260806 02:21:35.871964 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:21:35.878561 20940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.874572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46528 (local address 127.26.189.190:32841)
0806 02:21:35.874689 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:35.874693 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:35.874881 (+ 188us) server_negotiation.cc:407] Connection header received
0806 02:21:35.874979 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:35.874981 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:35.875018 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:35.875083 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:35.875285 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.875789 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.876852 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.877063 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.877142 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.878093 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:35.878096 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:35.878098 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:35.878109 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:35.878127 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:35.878134 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:35.878236 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:35.878424 (+ 188us) server_negotiation.cc:299] Negotiation successful
0806 02:21:35.878453 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 02:21:35.881649 20875 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46528:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:21:35.884652 20875 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:21:35.898540 21539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.893101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:45571 (local address 127.0.0.1:39970)
0806 02:21:35.893488 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:35.893569 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:35.893709 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:35.894273 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:35.894280 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:35.894307 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:35.894479 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:35.894487 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.895908 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.895913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:35.896809 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:35.896819 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.897979 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.897983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:35.898093 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.898132 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 02:21:35.898244 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 02:21:35.898386 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":103,"threads_started":1}
I20260806 02:21:35.898581 21542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.893248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39970 (local address 127.26.189.130:45571)
0806 02:21:35.893732 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:35.893744 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:35.893774 (+ 30us) server_negotiation.cc:407] Connection header received
0806 02:21:35.893862 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:35.893868 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:35.894090 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:35.894280 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:35.894654 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.895824 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.896938 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.897804 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.897923 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.898096 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:35.898297 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 02:21:35.898408 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":123,"threads_started":1}
I20260806 02:21:35.899703 21544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.893896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:37995 (local address 127.0.0.1:38126)
0806 02:21:35.894738 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:35.894751 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:35.894834 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:35.895638 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:35.895641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:35.895658 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:35.895738 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:35.895743 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.897087 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.897109 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:35.898284 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:35.898292 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.899353 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.899357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:35.899441 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.899463 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 02:21:35.899512 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 02:21:35.899575 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":776,"mutex_wait_us":23,"thread_start_us":98,"threads_started":1}
I20260806 02:21:35.899960 21547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.894506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59664 (local address 127.26.189.129:37481)
0806 02:21:35.894957 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:35.894968 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:35.894992 (+ 24us) server_negotiation.cc:407] Connection header received
0806 02:21:35.895063 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:35.895068 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:35.895265 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:35.895418 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:35.895669 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.896917 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.898391 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.899160 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.899281 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.899404 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:35.899672 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 02:21:35.899777 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":127,"threads_started":1}
I20260806 02:21:35.900520 21548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.894515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38126 (local address 127.26.189.131:37995)
0806 02:21:35.895212 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:35.895220 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:35.895239 (+ 19us) server_negotiation.cc:407] Connection header received
0806 02:21:35.895305 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:35.895309 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:35.895488 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:35.895649 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:35.895858 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.896948 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.898412 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.899212 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.900123 (+ 911us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.900274 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:35.900313 (+ 39us) server_negotiation.cc:299] Negotiation successful
0806 02:21:35.900377 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":171,"threads_started":1}
I20260806 02:21:35.901523 21543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:35.893328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:37481 (local address 127.0.0.1:59664)
0806 02:21:35.893886 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:35.893900 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:35.893993 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:35.895409 (+ 1416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:35.895412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:35.895430 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:35.895526 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:35.895533 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.897028 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.897031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:35.898241 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:35.898254 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:35.899457 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:35.899460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:35.899524 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:35.899542 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 02:21:35.899634 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 02:21:35.899706 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":53,"thread_start_us":102,"threads_started":1}
I20260806 02:21:35.902150 21242 tablet_service.cc:1467] Processing CreateTablet for tablet e6cf62bab1a44ee99398ae53f1154857 (DEFAULT_TABLE table=test-table [id=a8ebca534f3548bc81f6af1ed79dc43f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:35.903148 21242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6cf62bab1a44ee99398ae53f1154857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:35.902983 21428 tablet_service.cc:1467] Processing CreateTablet for tablet e6cf62bab1a44ee99398ae53f1154857 (DEFAULT_TABLE table=test-table [id=a8ebca534f3548bc81f6af1ed79dc43f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:35.903892 21428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6cf62bab1a44ee99398ae53f1154857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:35.907536 21057 tablet_service.cc:1467] Processing CreateTablet for tablet e6cf62bab1a44ee99398ae53f1154857 (DEFAULT_TABLE table=test-table [id=a8ebca534f3548bc81f6af1ed79dc43f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:35.908576 21057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6cf62bab1a44ee99398ae53f1154857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:35.909924 21549 tablet_bootstrap.cc:492] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa: Bootstrap starting.
I20260806 02:21:35.911814 21550 tablet_bootstrap.cc:492] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5: Bootstrap starting.
I20260806 02:21:35.912364 21549 tablet_bootstrap.cc:654] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:35.913112 21549 log.cc:824] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:35.914098 21550 tablet_bootstrap.cc:654] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:35.914973 21549 tablet_bootstrap.cc:492] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa: No bootstrap required, opened a new log
I20260806 02:21:35.914961 21550 log.cc:824] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:35.915179 21549 ts_tablet_manager.cc:1397] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 02:21:35.916467 21554 tablet_bootstrap.cc:492] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab: Bootstrap starting.
I20260806 02:21:35.918715 21554 tablet_bootstrap.cc:654] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:35.919340 21550 tablet_bootstrap.cc:492] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5: No bootstrap required, opened a new log
I20260806 02:21:35.919575 21550 ts_tablet_manager.cc:1397] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260806 02:21:35.919662 21554 log.cc:824] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:35.919974 21549 raft_consensus.cc:348] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4dcc4721624500805db1967321e5f5" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45571 } } peers { permanent_uuid: "2a33449566694187b10881e5e0a2e6ab" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37481 } } peers { permanent_uuid: "3bc0901affb1487dabc21a65c28aa6aa" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 37995 } }
I20260806 02:21:35.920279 21549 raft_consensus.cc:374] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:35.920356 21549 raft_consensus.cc:729] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bc0901affb1487dabc21a65c28aa6aa, State: Initialized, Role: FOLLOWER
I20260806 02:21:35.920900 21549 consensus_queue.cc:260] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4dcc4721624500805db1967321e5f5" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45571 } } peers { permanent_uuid: "2a33449566694187b10881e5e0a2e6ab" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37481 } } peers { permanent_uuid: "3bc0901affb1487dabc21a65c28aa6aa" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 37995 } }
I20260806 02:21:35.921654 21525 heartbeater.cc:503] Master 127.26.189.190:32841 was elected leader, sending a full tablet report...
I20260806 02:21:35.921952 21554 tablet_bootstrap.cc:492] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab: No bootstrap required, opened a new log
I20260806 02:21:35.922055 21549 ts_tablet_manager.cc:1428] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 02:21:35.922791 21554 ts_tablet_manager.cc:1397] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:21:35.923839 21550 raft_consensus.cc:348] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4dcc4721624500805db1967321e5f5" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45571 } } peers { permanent_uuid: "2a33449566694187b10881e5e0a2e6ab" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37481 } } peers { permanent_uuid: "3bc0901affb1487dabc21a65c28aa6aa" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 37995 } }
I20260806 02:21:35.924065 21550 raft_consensus.cc:374] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:35.924153 21550 raft_consensus.cc:729] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4dcc4721624500805db1967321e5f5, State: Initialized, Role: FOLLOWER
I20260806 02:21:35.924572 21550 consensus_queue.cc:260] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4dcc4721624500805db1967321e5f5" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45571 } } peers { permanent_uuid: "2a33449566694187b10881e5e0a2e6ab" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37481 } } peers { permanent_uuid: "3bc0901affb1487dabc21a65c28aa6aa" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 37995 } }
I20260806 02:21:35.925216 21338 heartbeater.cc:503] Master 127.26.189.190:32841 was elected leader, sending a full tablet report...
I20260806 02:21:35.925565 21550 ts_tablet_manager.cc:1428] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s
I20260806 02:21:35.927099 21554 raft_consensus.cc:348] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4dcc4721624500805db1967321e5f5" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45571 } } peers { permanent_uuid: "2a33449566694187b10881e5e0a2e6ab" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37481 } } peers { permanent_uuid: "3bc0901affb1487dabc21a65c28aa6aa" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 37995 } }
I20260806 02:21:35.927367 21554 raft_consensus.cc:374] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:35.927428 21554 raft_consensus.cc:729] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a33449566694187b10881e5e0a2e6ab, State: Initialized, Role: FOLLOWER
I20260806 02:21:35.927834 21554 consensus_queue.cc:260] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4dcc4721624500805db1967321e5f5" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45571 } } peers { permanent_uuid: "2a33449566694187b10881e5e0a2e6ab" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37481 } } peers { permanent_uuid: "3bc0901affb1487dabc21a65c28aa6aa" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 37995 } }
I20260806 02:21:35.928443 21153 heartbeater.cc:503] Master 127.26.189.190:32841 was elected leader, sending a full tablet report...
I20260806 02:21:35.929657 21554 ts_tablet_manager.cc:1428] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
W20260806 02:21:35.952019 21155 tablet.cc:2369] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 02:21:36.100404 21526 tablet.cc:2369] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 02:21:36.159708 21339 tablet.cc:2369] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:21:36.183903 21558 raft_consensus.cc:482] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:21:36.184199 21558 raft_consensus.cc:504] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4dcc4721624500805db1967321e5f5" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45571 } } peers { permanent_uuid: "2a33449566694187b10881e5e0a2e6ab" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37481 } } peers { permanent_uuid: "3bc0901affb1487dabc21a65c28aa6aa" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 37995 } }
I20260806 02:21:36.185818 21558 leader_election.cc:288] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4dcc4721624500805db1967321e5f5 (127.26.189.130:45571), 3bc0901affb1487dabc21a65c28aa6aa (127.26.189.131:37995)
I20260806 02:21:36.190383 21542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:36.186230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:43715 (local address 127.26.189.130:45571)
0806 02:21:36.186377 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:36.186382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:36.186677 (+ 295us) server_negotiation.cc:407] Connection header received
0806 02:21:36.186818 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:36.186821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:36.186882 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:36.187286 (+ 404us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:36.187374 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:36.187900 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:36.189226 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:36.189813 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:36.189905 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:36.189943 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:36.190171 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 02:21:36.190228 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 02:21:36.190426 21559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:36.186005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:45571 (local address 127.26.189.129:43715)
0806 02:21:36.186573 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:36.186590 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:36.186712 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:36.187025 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:36.187029 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:36.187052 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:36.187190 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:36.187196 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:36.188006 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:36.188009 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:36.189088 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:36.189098 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:36.189924 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:36.189928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:36.190029 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:36.190056 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 02:21:36.190157 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 02:21:36.190261 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":20,"thread_start_us":122,"threads_started":1}
I20260806 02:21:36.190824 21548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:36.186300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:48897 (local address 127.26.189.131:37995)
0806 02:21:36.186485 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:36.186490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:36.187221 (+ 731us) server_negotiation.cc:407] Connection header received
0806 02:21:36.187347 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:36.187350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:36.187400 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:36.187489 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:36.187765 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:36.188453 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:36.189652 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:36.190201 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:36.190310 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:36.190353 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:36.190632 (+ 279us) server_negotiation.cc:299] Negotiation successful
0806 02:21:36.190719 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 02:21:36.191083 21274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6cf62bab1a44ee99398ae53f1154857" candidate_uuid: "2a33449566694187b10881e5e0a2e6ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4dcc4721624500805db1967321e5f5" is_pre_election: true
I20260806 02:21:36.191185 21560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:36.186641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:37995 (local address 127.26.189.129:48897)
0806 02:21:36.187109 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:36.187122 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:36.187253 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:36.187502 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:36.187505 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:36.187521 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:36.187657 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:36.187663 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:36.188573 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:36.188576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:36.189504 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:36.189514 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:36.190319 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:36.190323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:36.190441 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:36.190472 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 02:21:36.190983 (+ 511us) client_negotiation.cc:240] Negotiation successful
0806 02:21:36.191057 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"mutex_wait_us":3,"thread_start_us":155,"threads_started":1}
I20260806 02:21:36.191447 21274 raft_consensus.cc:2454] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a33449566694187b10881e5e0a2e6ab in term 0.
I20260806 02:21:36.191963 20988 leader_election.cc:302] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a33449566694187b10881e5e0a2e6ab, ec4dcc4721624500805db1967321e5f5; no voters:
I20260806 02:21:36.191944 21452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6cf62bab1a44ee99398ae53f1154857" candidate_uuid: "2a33449566694187b10881e5e0a2e6ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bc0901affb1487dabc21a65c28aa6aa" is_pre_election: true
I20260806 02:21:36.192230 21452 raft_consensus.cc:2454] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a33449566694187b10881e5e0a2e6ab in term 0.
I20260806 02:21:36.192267 21558 raft_consensus.cc:2781] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:21:36.192381 21558 raft_consensus.cc:482] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:21:36.192440 21558 raft_consensus.cc:3037] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:36.193506 21558 raft_consensus.cc:504] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4dcc4721624500805db1967321e5f5" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45571 } } peers { permanent_uuid: "2a33449566694187b10881e5e0a2e6ab" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37481 } } peers { permanent_uuid: "3bc0901affb1487dabc21a65c28aa6aa" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 37995 } }
I20260806 02:21:36.193913 21558 leader_election.cc:288] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [CANDIDATE]: Term 1 election: Requested vote from peers ec4dcc4721624500805db1967321e5f5 (127.26.189.130:45571), 3bc0901affb1487dabc21a65c28aa6aa (127.26.189.131:37995)
I20260806 02:21:36.194312 21452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6cf62bab1a44ee99398ae53f1154857" candidate_uuid: "2a33449566694187b10881e5e0a2e6ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bc0901affb1487dabc21a65c28aa6aa"
I20260806 02:21:36.194312 21274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6cf62bab1a44ee99398ae53f1154857" candidate_uuid: "2a33449566694187b10881e5e0a2e6ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4dcc4721624500805db1967321e5f5"
I20260806 02:21:36.194443 21452 raft_consensus.cc:3037] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:36.194443 21274 raft_consensus.cc:3037] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:36.195736 21274 raft_consensus.cc:2454] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a33449566694187b10881e5e0a2e6ab in term 1.
I20260806 02:21:36.195763 21452 raft_consensus.cc:2454] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a33449566694187b10881e5e0a2e6ab in term 1.
I20260806 02:21:36.196058 20988 leader_election.cc:302] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a33449566694187b10881e5e0a2e6ab, ec4dcc4721624500805db1967321e5f5; no voters:
I20260806 02:21:36.196240 21558 raft_consensus.cc:2781] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:36.196440 21558 raft_consensus.cc:686] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [term 1 LEADER]: Becoming Leader. State: Replica: 2a33449566694187b10881e5e0a2e6ab, State: Running, Role: LEADER
I20260806 02:21:36.196740 21558 consensus_queue.cc:237] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4dcc4721624500805db1967321e5f5" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45571 } } peers { permanent_uuid: "2a33449566694187b10881e5e0a2e6ab" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37481 } } peers { permanent_uuid: "3bc0901affb1487dabc21a65c28aa6aa" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 37995 } }
I20260806 02:21:36.199730 20874 catalog_manager.cc:5495] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a33449566694187b10881e5e0a2e6ab (127.26.189.129). New cstate: current_term: 1 leader_uuid: "2a33449566694187b10881e5e0a2e6ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4dcc4721624500805db1967321e5f5" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a33449566694187b10881e5e0a2e6ab" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 37481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bc0901affb1487dabc21a65c28aa6aa" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 37995 } health_report { overall_health: UNKNOWN } } }
I20260806 02:21:36.264470 21547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:36.260420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60886 (local address 127.26.189.129:37481)
0806 02:21:36.260576 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:36.260583 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:36.260601 (+ 18us) server_negotiation.cc:407] Connection header received
0806 02:21:36.260816 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:36.260819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:36.260887 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:36.261014 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:21:36.261328 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:36.261898 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:36.262820 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:36.263062 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:36.263193 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:36.263559 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:21:36.263974 (+ 415us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:21:36.264163 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:36.264269 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 02:21:36.264308 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 02:21:36.270521 21452 raft_consensus.cc:1261] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa [term 1 FOLLOWER]: Refusing update from remote peer 2a33449566694187b10881e5e0a2e6ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:21:36.270529 21274 raft_consensus.cc:1261] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5 [term 1 FOLLOWER]: Refusing update from remote peer 2a33449566694187b10881e5e0a2e6ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:21:36.271214 21558 consensus_queue.cc:1035] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bc0901affb1487dabc21a65c28aa6aa" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:21:36.271415 21563 consensus_queue.cc:1035] T e6cf62bab1a44ee99398ae53f1154857 P 2a33449566694187b10881e5e0a2e6ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4dcc4721624500805db1967321e5f5" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:21:36.281445 21570 mvcc.cc:205] Tried to move back new op lower bound from 7315385943116365824 to 7315385942824124416. Current Snapshot: MvccSnapshot[applied={T|T < 7315385943116365824}]
I20260806 02:21:36.287092 20874 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46528:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:21:36.287278 20874 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46528:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:21:36.289634 20874 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 698e3f6718a3470d8cb9a332e529df29: Sending DeleteTablet for 3 replicas of tablet e6cf62bab1a44ee99398ae53f1154857
I20260806 02:21:36.290360 21242 tablet_service.cc:1514] Processing DeleteTablet for tablet e6cf62bab1a44ee99398ae53f1154857 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:36 UTC) from {username='slave'} at 127.0.0.1:39970
I20260806 02:21:36.290613 21428 tablet_service.cc:1514] Processing DeleteTablet for tablet e6cf62bab1a44ee99398ae53f1154857 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:36 UTC) from {username='slave'} at 127.0.0.1:38126
I20260806 02:21:36.291193 21583 tablet_replica.cc:330] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa: stopping tablet replica
I20260806 02:21:36.291185 21057 tablet_service.cc:1514] Processing DeleteTablet for tablet e6cf62bab1a44ee99398ae53f1154857 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:36 UTC) from {username='slave'} at 127.0.0.1:59664
I20260806 02:21:36.291407 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 20968
I20260806 02:21:36.291550 21583 raft_consensus.cc:2229] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:21:36.291864 21583 raft_consensus.cc:2258] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:36.295580 21581 tablet_replica.cc:330] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5: stopping tablet replica
I20260806 02:21:36.295876 21581 raft_consensus.cc:2229] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:21:36.296190 21581 raft_consensus.cc:2258] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:36.298561 21581 ts_tablet_manager.cc:1905] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:21:36.299198 21583 ts_tablet_manager.cc:1905] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:21:36.301318 21583 ts_tablet_manager.cc:1918] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:21:36.301436 21583 log.cc:1196] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/e6cf62bab1a44ee99398ae53f1154857
I20260806 02:21:36.301770 21583 ts_tablet_manager.cc:1939] T e6cf62bab1a44ee99398ae53f1154857 P 3bc0901affb1487dabc21a65c28aa6aa: Deleting consensus metadata
I20260806 02:21:36.302385 21581 ts_tablet_manager.cc:1918] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:21:36.302502 21581 log.cc:1196] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/e6cf62bab1a44ee99398ae53f1154857
I20260806 02:21:36.302858 21581 ts_tablet_manager.cc:1939] T e6cf62bab1a44ee99398ae53f1154857 P ec4dcc4721624500805db1967321e5f5: Deleting consensus metadata
I20260806 02:21:36.302982 20851 catalog_manager.cc:4841] TS 3bc0901affb1487dabc21a65c28aa6aa (127.26.189.131:37995): tablet e6cf62bab1a44ee99398ae53f1154857 (table test-table [id=a8ebca534f3548bc81f6af1ed79dc43f]) successfully deleted
I20260806 02:21:36.304114 20848 catalog_manager.cc:4841] TS ec4dcc4721624500805db1967321e5f5 (127.26.189.130:45571): tablet e6cf62bab1a44ee99398ae53f1154857 (table test-table [id=a8ebca534f3548bc81f6af1ed79dc43f]) successfully deleted
W20260806 02:21:36.306344 20851 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:37481 (error 108)
I20260806 02:21:36.306483 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 21157
I20260806 02:21:36.309216 21543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:36.308823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:37481 (local address 127.0.0.1:60888)
0806 02:21:36.309026 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:36.309118 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:37481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
W20260806 02:21:36.309376 20851 catalog_manager.cc:4584] TS 2a33449566694187b10881e5e0a2e6ab (127.26.189.129:37481): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e6cf62bab1a44ee99398ae53f1154857: Network error: Client connection negotiation failed: client connection to 127.26.189.129:37481: connect: Connection refused (error 111)
I20260806 02:21:36.317838 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 21341
I20260806 02:21:36.329911 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 20828
2026-08-06T02:21:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1343 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:36 dist-test-slave-gkw7 krb5kdc[21587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:36 dist-test-slave-gkw7 krb5kdc[21587](info): set up 2 sockets
Aug 06 02:21:36 dist-test-slave-gkw7 krb5kdc[21587](info): commencing operation
krb5kdc: starting...
W20260806 02:21:37.580015 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:37 dist-test-slave-gkw7 krb5kdc[21587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:21:37.716751 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:33317
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:34989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:33317
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:37.835465 21608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:37.835767 21608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:37.835835 21608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:37.839835 21608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:37.839923 21608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:37.839959 21608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:37.839996 21608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:37.840029 21608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:37.845975 21608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:33317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:33317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:37.847101 21608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:37.848196 21608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:37.857146 21614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:37.857157 21615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:37.857278 21608 server_base.cc:1034] running on GCE node
W20260806 02:21:37.857153 21617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:37.858053 21608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:37.859190 21608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:37.860355 21608 hybrid_clock.cc:648] HybridClock initialized: now 1785982897860334 us; error 31 us; skew 500 ppm
Aug 06 02:21:37 dist-test-slave-gkw7 krb5kdc[21587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982897, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:37.863310 21608 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:21:37.864187 21608 webserver.cc:460] Webserver started at http://127.26.189.190:45483/ using document root <none> and password file <none>
I20260806 02:21:37.864755 21608 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:37.864845 21608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:37.865087 21608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:37.867215 21608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "6ae720ea77a2490a85c8f4549bbcc0cb"
format_stamp: "Formatted at 2026-08-06 02:21:37 on dist-test-slave-gkw7"
server_key: "504573c6c67540ca7e4a8a7abb8fa5a4"
server_key_iv: "5ead127e201a071a9f68a8ee65669d1d"
server_key_version: "encryptionkey@0"
I20260806 02:21:37.867790 21608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "6ae720ea77a2490a85c8f4549bbcc0cb"
format_stamp: "Formatted at 2026-08-06 02:21:37 on dist-test-slave-gkw7"
server_key: "504573c6c67540ca7e4a8a7abb8fa5a4"
server_key_iv: "5ead127e201a071a9f68a8ee65669d1d"
server_key_version: "encryptionkey@0"
I20260806 02:21:37.871681 21608 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260806 02:21:37.874182 21627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:37.875362 21608 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 02:21:37.875499 21608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "6ae720ea77a2490a85c8f4549bbcc0cb"
format_stamp: "Formatted at 2026-08-06 02:21:37 on dist-test-slave-gkw7"
server_key: "504573c6c67540ca7e4a8a7abb8fa5a4"
server_key_iv: "5ead127e201a071a9f68a8ee65669d1d"
server_key_version: "encryptionkey@0"
I20260806 02:21:37.875608 21608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:37.891655 21608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:37.895126 21608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:37.895349 21608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:37.902585 21608 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:33317
I20260806 02:21:37.902633 21704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:33317 every 8 connection(s)
I20260806 02:21:37.903571 21608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:37.904052 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 21608
I20260806 02:21:37.904235 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:37.904546 27382 external_mini_cluster.cc:1428] Setting key 7a6f59ecec5f6ae05460a05091a58f8e
I20260806 02:21:37.907621 21705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 02:21:37 dist-test-slave-gkw7 krb5kdc[21587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:21:37.914670 21705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb: Bootstrap starting.
I20260806 02:21:37.916960 21705 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:37.917762 21705 log.cc:824] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:37.918845 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:37.905931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54978 (local address 127.26.189.190:33317)
0806 02:21:37.906314 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:37.906330 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:37.906365 (+ 35us) server_negotiation.cc:407] Connection header received
0806 02:21:37.906997 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:37.907013 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:37.907339 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:37.907621 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:37.908506 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:37.909502 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:37.910797 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:37.911270 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:37.911390 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:37.914311 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:37.914316 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:37.914328 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:37.914355 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:37.916019 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:37.916464 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:37.916469 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:37.916474 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:37.916582 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:37.916872 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:37.916875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:37.916877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:37.917315 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:37.917518 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:37.917851 (+ 333us) server_negotiation.cc:299] Negotiation successful
0806 02:21:37.918131 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":112,"threads_started":1}
I20260806 02:21:37.920728 21705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb: No bootstrap required, opened a new log
I20260806 02:21:37.924724 21705 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ae720ea77a2490a85c8f4549bbcc0cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33317 } }
I20260806 02:21:37.924938 21705 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:37.925012 21705 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ae720ea77a2490a85c8f4549bbcc0cb, State: Initialized, Role: FOLLOWER
I20260806 02:21:37.925419 21705 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ae720ea77a2490a85c8f4549bbcc0cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33317 } }
I20260806 02:21:37.925586 21705 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:37.925660 21705 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:37.925752 21705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:37.926713 21705 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ae720ea77a2490a85c8f4549bbcc0cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33317 } }
I20260806 02:21:37.927054 21705 leader_election.cc:302] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ae720ea77a2490a85c8f4549bbcc0cb; no voters:
I20260806 02:21:37.927404 21705 leader_election.cc:288] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:37.927526 21712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:37.927809 21712 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [term 1 LEADER]: Becoming Leader. State: Replica: 6ae720ea77a2490a85c8f4549bbcc0cb, State: Running, Role: LEADER
I20260806 02:21:37.928146 21712 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ae720ea77a2490a85c8f4549bbcc0cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33317 } }
I20260806 02:21:37.928731 21705 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:37.929239 21712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ae720ea77a2490a85c8f4549bbcc0cb. Latest consensus state: current_term: 1 leader_uuid: "6ae720ea77a2490a85c8f4549bbcc0cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ae720ea77a2490a85c8f4549bbcc0cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33317 } } }
I20260806 02:21:37.929363 21712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:37.929926 21714 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ae720ea77a2490a85c8f4549bbcc0cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ae720ea77a2490a85c8f4549bbcc0cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33317 } } }
I20260806 02:21:37.930030 21714 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:37.930130 21717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:37.933064 21717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:37.938658 21717 catalog_manager.cc:1347] Generated new cluster ID: 164d2af5a09549ccbe574c1323c27112
I20260806 02:21:37.938730 21717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:37.946678 21717 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:37.947692 21717 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:37.956699 21717 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb: Generated new TSK 0
I20260806 02:21:37.957424 21717 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.189.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
Entry for principal kudu/127.26.189.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab.
I20260806 02:21:37.990779 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:33317
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:34989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:38.116307 21739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:38.116601 21739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:38.116688 21739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:38.120942 21739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:38.121014 21739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:38.121112 21739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:21:38.126587 21739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.129.keytab
--principal=kudu/127.26.189.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:33317
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:38.127704 21739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:38.128921 21739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:38.139050 21746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:38.139060 21749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:38.139030 21747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:38.139432 21739 server_base.cc:1034] running on GCE node
I20260806 02:21:38.139865 21739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:38.140477 21739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:38.141601 21739 hybrid_clock.cc:648] HybridClock initialized: now 1785982898141583 us; error 29 us; skew 500 ppm
Aug 06 02:21:38 dist-test-slave-gkw7 krb5kdc[21587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982898, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:38.144549 21739 init.cc:377] Logged in from keytab as kudu/127.26.189.129@KRBTEST.COM (short username kudu)
I20260806 02:21:38.145430 21739 webserver.cc:460] Webserver started at http://127.26.189.129:45041/ using document root <none> and password file <none>
I20260806 02:21:38.146032 21739 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:38.146121 21739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:38.146358 21739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:38.148511 21739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "104170c6d8a14d0782598b9987bc875a"
format_stamp: "Formatted at 2026-08-06 02:21:38 on dist-test-slave-gkw7"
server_key: "3906a36a608063124322703bde89a5f0"
server_key_iv: "35aedb49818bd7b2ff310088b55da405"
server_key_version: "encryptionkey@0"
I20260806 02:21:38.149083 21739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "104170c6d8a14d0782598b9987bc875a"
format_stamp: "Formatted at 2026-08-06 02:21:38 on dist-test-slave-gkw7"
server_key: "3906a36a608063124322703bde89a5f0"
server_key_iv: "35aedb49818bd7b2ff310088b55da405"
server_key_version: "encryptionkey@0"
I20260806 02:21:38.152994 21739 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:21:38.155627 21759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:38.156899 21739 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:38.157028 21739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "104170c6d8a14d0782598b9987bc875a"
format_stamp: "Formatted at 2026-08-06 02:21:38 on dist-test-slave-gkw7"
server_key: "3906a36a608063124322703bde89a5f0"
server_key_iv: "35aedb49818bd7b2ff310088b55da405"
server_key_version: "encryptionkey@0"
I20260806 02:21:38.157145 21739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:38.167891 21739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:38.170712 21739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:38.170907 21739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:38.171489 21739 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:38.172307 21739 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:38.172374 21739 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:38.172443 21739 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:38.172484 21739 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:38.182559 21739 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:35787
I20260806 02:21:38.182579 21906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:35787 every 8 connection(s)
I20260806 02:21:38.183528 21739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:21:38.188985 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 21739
I20260806 02:21:38.189145 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:21:38.189495 27382 external_mini_cluster.cc:1428] Setting key 132c89404aaa493869085a11f4a38fda
Aug 06 02:21:38 dist-test-slave-gkw7 krb5kdc[21587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982898, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.129@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:21:38.199890 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.185519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:41351 (local address 127.26.189.190:33317)
0806 02:21:38.185693 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:38.185697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:38.186603 (+ 906us) server_negotiation.cc:407] Connection header received
0806 02:21:38.187954 (+ 1351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:38.187957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:38.188007 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:38.188086 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:38.189402 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.190188 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.191519 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.191899 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.192026 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.195352 (+ 3326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:38.195359 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:38.195365 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:38.195401 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:38.197495 (+ 2094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:38.198075 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:38.198082 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:38.198087 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:38.198192 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:38.198543 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:38.198549 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:38.198552 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:38.198841 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:38.198964 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:38.199533 (+ 569us) server_negotiation.cc:299] Negotiation successful
0806 02:21:38.199685 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 02:21:38.200711 21909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.185938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:33317 (local address 127.26.189.129:41351)
0806 02:21:38.186431 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:38.186478 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:38.187745 (+ 1267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:38.188287 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:38.188293 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:38.188657 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:38.189224 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.189252 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.190324 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.190328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.191388 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.191399 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.192116 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.192122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.192370 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.193160 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:21:38.193185 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:38.195176 (+ 1991us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:38.197662 (+ 2486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:38.197667 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:38.197681 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:38.197951 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:38.198301 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:38.198303 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:38.198305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:38.198445 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:38.198997 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:38.199003 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:38.199269 (+ 266us) client_negotiation.cc:769] Sending connection context
0806 02:21:38.199441 (+ 172us) client_negotiation.cc:240] Negotiation successful
0806 02:21:38.199740 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.26.189.130@KRBTEST.COM; defaulting to no policy
I20260806 02:21:38.202316 21907 heartbeater.cc:347] Connected to a master server at 127.26.189.190:33317
I20260806 02:21:38.202597 21907 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:38.203131 21907 heartbeater.cc:511] Master 127.26.189.190:33317 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.130@KRBTEST.COM" created.
I20260806 02:21:38.204809 21653 ts_manager.cc:194] Registered new tserver with Master: 104170c6d8a14d0782598b9987bc875a (127.26.189.129:35787)
I20260806 02:21:38.206477 21653 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.129@KRBTEST.COM'} at 127.26.189.129:41351
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
Entry for principal kudu/127.26.189.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab.
I20260806 02:21:38.221186 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:33317
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:34989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:38.354107 21913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:38.354368 21913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:38.354410 21913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:38.358440 21913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:38.358497 21913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:38.358556 21913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:21:38.363873 21913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.130.keytab
--principal=kudu/127.26.189.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:33317
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:38.364883 21913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:38.365895 21913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:38.375461 21920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:38.375474 21921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:38.375474 21923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:38.375725 21913 server_base.cc:1034] running on GCE node
I20260806 02:21:38.376199 21913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:38.376823 21913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:38.377975 21913 hybrid_clock.cc:648] HybridClock initialized: now 1785982898377942 us; error 43 us; skew 500 ppm
Aug 06 02:21:38 dist-test-slave-gkw7 krb5kdc[21587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982898, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:38.381003 21913 init.cc:377] Logged in from keytab as kudu/127.26.189.130@KRBTEST.COM (short username kudu)
I20260806 02:21:38.381984 21913 webserver.cc:460] Webserver started at http://127.26.189.130:44197/ using document root <none> and password file <none>
I20260806 02:21:38.382556 21913 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:38.382620 21913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:38.382856 21913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:38.384893 21913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "db2ac3e10cca4f4c9f08387611fd56ca"
format_stamp: "Formatted at 2026-08-06 02:21:38 on dist-test-slave-gkw7"
server_key: "dccdbcb3b66e82bad990decfd723f9cf"
server_key_iv: "9e316ecf7f42521a22001e5c5691b62b"
server_key_version: "encryptionkey@0"
I20260806 02:21:38.385469 21913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "db2ac3e10cca4f4c9f08387611fd56ca"
format_stamp: "Formatted at 2026-08-06 02:21:38 on dist-test-slave-gkw7"
server_key: "dccdbcb3b66e82bad990decfd723f9cf"
server_key_iv: "9e316ecf7f42521a22001e5c5691b62b"
server_key_version: "encryptionkey@0"
I20260806 02:21:38.389248 21913 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:21:38.391769 21931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:38.393074 21913 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:38.393217 21913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "db2ac3e10cca4f4c9f08387611fd56ca"
format_stamp: "Formatted at 2026-08-06 02:21:38 on dist-test-slave-gkw7"
server_key: "dccdbcb3b66e82bad990decfd723f9cf"
server_key_iv: "9e316ecf7f42521a22001e5c5691b62b"
server_key_version: "encryptionkey@0"
I20260806 02:21:38.393326 21913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:38.410737 21913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:38.414213 21913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:38.414422 21913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:38.415036 21913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:38.415901 21913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:38.415949 21913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:38.416016 21913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:38.416052 21913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:38.424832 21913 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:39739
I20260806 02:21:38.424856 22086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:39739 every 8 connection(s)
I20260806 02:21:38.425812 21913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:21:38.428759 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 21913
I20260806 02:21:38.428906 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:21:38.429275 27382 external_mini_cluster.cc:1428] Setting key f6e796999c44a890f3baf4e5fd09d3e5
Aug 06 02:21:38 dist-test-slave-gkw7 krb5kdc[21587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982898, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.130@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.131@KRBTEST.COM; defaulting to no policy
I20260806 02:21:38.441298 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.427652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:47183 (local address 127.26.189.190:33317)
0806 02:21:38.427798 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:38.427802 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:38.428621 (+ 819us) server_negotiation.cc:407] Connection header received
0806 02:21:38.430432 (+ 1811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:38.430434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:38.430480 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:38.430544 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:38.431888 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.432417 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.433635 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.433869 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.433983 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.437006 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:38.437012 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:38.437018 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:38.437056 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:38.439064 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:38.439625 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:38.439628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:38.439630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:38.439733 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:38.440079 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:38.440085 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:38.440089 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:38.440369 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:38.440473 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:38.441051 (+ 578us) server_negotiation.cc:299] Negotiation successful
0806 02:21:38.441162 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:21:38.442261 22089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.428019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:33317 (local address 127.26.189.130:47183)
0806 02:21:38.428481 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:38.428524 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:38.430193 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:38.430763 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:38.430772 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:38.431246 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:38.431746 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.431760 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.432542 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.432546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.433456 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.433466 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.434022 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.434026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.434218 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.434835 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:21:38.434851 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:38.436806 (+ 1955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:38.439208 (+ 2402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:38.439214 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:38.439230 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:38.439517 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:38.439829 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:38.439832 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:38.439833 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:38.439977 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:38.440479 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:38.440484 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:38.440802 (+ 318us) client_negotiation.cc:769] Sending connection context
0806 02:21:38.440973 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 02:21:38.441297 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":103,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.131@KRBTEST.COM" created.
I20260806 02:21:38.443626 22087 heartbeater.cc:347] Connected to a master server at 127.26.189.190:33317
I20260806 02:21:38.443903 22087 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:38.444537 22087 heartbeater.cc:511] Master 127.26.189.190:33317 requested a full tablet report, sending...
I20260806 02:21:38.445770 21653 ts_manager.cc:194] Registered new tserver with Master: db2ac3e10cca4f4c9f08387611fd56ca (127.26.189.130:39739)
I20260806 02:21:38.446373 21653 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.130@KRBTEST.COM'} at 127.26.189.130:47183
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
Entry for principal kudu/127.26.189.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab.
I20260806 02:21:38.460162 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:33317
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:34989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:38.575311 22093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:38.575562 22093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:38.575642 22093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:38.579746 22093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:38.579808 22093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:38.579891 22093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:21:38.585258 22093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.131.keytab
--principal=kudu/127.26.189.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:33317
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:38.586349 22093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:38.587373 22093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:38.597513 22098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:38.597486 22102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:38.597498 22099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:38.598016 22093 server_base.cc:1034] running on GCE node
I20260806 02:21:38.598464 22093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:38.599093 22093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:38.600291 22093 hybrid_clock.cc:648] HybridClock initialized: now 1785982898600272 us; error 31 us; skew 500 ppm
Aug 06 02:21:38 dist-test-slave-gkw7 krb5kdc[21587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982898, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:38.603055 22093 init.cc:377] Logged in from keytab as kudu/127.26.189.131@KRBTEST.COM (short username kudu)
I20260806 02:21:38.603858 22093 webserver.cc:460] Webserver started at http://127.26.189.131:43039/ using document root <none> and password file <none>
I20260806 02:21:38.604372 22093 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:38.604429 22093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:38.604591 22093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:38.606653 22093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "578bf9cb23f64772929808253e3b5bd7"
format_stamp: "Formatted at 2026-08-06 02:21:38 on dist-test-slave-gkw7"
server_key: "4136687e1df4fda7017a8d51f98bd7bf"
server_key_iv: "a9c874fbdfccfaf54fc0e8a43df4bb26"
server_key_version: "encryptionkey@0"
I20260806 02:21:38.607175 22093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "578bf9cb23f64772929808253e3b5bd7"
format_stamp: "Formatted at 2026-08-06 02:21:38 on dist-test-slave-gkw7"
server_key: "4136687e1df4fda7017a8d51f98bd7bf"
server_key_iv: "a9c874fbdfccfaf54fc0e8a43df4bb26"
server_key_version: "encryptionkey@0"
I20260806 02:21:38.610858 22093 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:21:38.613271 22109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:38.614547 22093 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:38.614677 22093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "578bf9cb23f64772929808253e3b5bd7"
format_stamp: "Formatted at 2026-08-06 02:21:38 on dist-test-slave-gkw7"
server_key: "4136687e1df4fda7017a8d51f98bd7bf"
server_key_iv: "a9c874fbdfccfaf54fc0e8a43df4bb26"
server_key_version: "encryptionkey@0"
I20260806 02:21:38.614792 22093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:38.640911 22093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:38.643929 22093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:38.644135 22093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:38.644764 22093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:38.645630 22093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:38.645704 22093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:38.645771 22093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:38.645820 22093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:38.655025 22093 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:33689
I20260806 02:21:38.655097 22263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:33689 every 8 connection(s)
I20260806 02:21:38.655931 22093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:21:38.657482 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 22093
I20260806 02:21:38.657673 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:21:38.658061 27382 external_mini_cluster.cc:1428] Setting key 6b1c425437ded78d2b50a77bd3a1fd95
Aug 06 02:21:38 dist-test-slave-gkw7 krb5kdc[21587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982898, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.131@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:21:38.672390 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.657851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:57931 (local address 127.26.189.190:33317)
0806 02:21:38.658029 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:38.658034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:38.658959 (+ 925us) server_negotiation.cc:407] Connection header received
0806 02:21:38.660818 (+ 1859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:38.660821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:38.660880 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:38.660994 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:38.662683 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.663319 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.664705 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.664964 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.665098 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.668045 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:38.668050 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:38.668059 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:38.668087 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:38.669869 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:38.670494 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:38.670498 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:38.670500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:38.670602 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:38.671052 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:38.671057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:38.671059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:38.671325 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:38.671452 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:38.672035 (+ 583us) server_negotiation.cc:299] Negotiation successful
0806 02:21:38.672178 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 02:21:38.673240 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.658292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:33317 (local address 127.26.189.131:57931)
0806 02:21:38.658812 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:38.658872 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:38.660610 (+ 1738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:38.661223 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:38.661231 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:38.661678 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:38.662496 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.662516 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.663473 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.663477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.664546 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.664569 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.665169 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.665175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.665356 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.666119 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:21:38.666137 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:38.667859 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:38.670018 (+ 2159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:38.670025 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:38.670041 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:38.670343 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:38.670717 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:21:38.670720 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:21:38.670722 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:21:38.670940 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:21:38.671464 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:38.671475 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:38.671760 (+ 285us) client_negotiation.cc:769] Sending connection context
0806 02:21:38.671987 (+ 227us) client_negotiation.cc:240] Negotiation successful
0806 02:21:38.672350 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":115,"threads_started":1}
I20260806 02:21:38.674393 22264 heartbeater.cc:347] Connected to a master server at 127.26.189.190:33317
I20260806 02:21:38.674638 22264 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:38.675123 22264 heartbeater.cc:511] Master 127.26.189.190:33317 requested a full tablet report, sending...
I20260806 02:21:38.676167 21653 ts_manager.cc:194] Registered new tserver with Master: 578bf9cb23f64772929808253e3b5bd7 (127.26.189.131:33689)
I20260806 02:21:38.676864 21653 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.189.131@KRBTEST.COM'} at 127.26.189.131:57931
I20260806 02:21:38.683781 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:21:38.693807 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.686302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54986 (local address 127.26.189.190:33317)
0806 02:21:38.686435 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:38.686445 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:38.686640 (+ 195us) server_negotiation.cc:407] Connection header received
0806 02:21:38.686728 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:38.686731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:38.686780 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:38.686886 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:38.687545 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.688073 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.688901 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.689168 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.689278 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.690625 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:38.690629 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:38.690630 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:38.690680 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:38.692173 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:38.692546 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:38.692548 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:38.692550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:38.692624 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:38.692898 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:38.692901 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:38.692903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:38.693166 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:38.693283 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:38.693497 (+ 214us) server_negotiation.cc:299] Negotiation successful
0806 02:21:38.693681 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 02:21:38.696787 21653 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54986:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:21:38.700316 21653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:21:38.715207 22278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.709422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:35787 (local address 127.0.0.1:44542)
0806 02:21:38.710561 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:38.710574 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:38.710661 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:38.711191 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:38.711194 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:38.711211 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:38.711313 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.711319 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.712597 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.712601 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.713749 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.713761 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.714651 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.714655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.714761 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.714799 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 02:21:38.714912 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 02:21:38.715031 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1076,"mutex_wait_us":1,"thread_start_us":123,"threads_started":1}
I20260806 02:21:38.715425 22279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.709168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34118 (local address 127.26.189.130:39739)
0806 02:21:38.710314 (+ 1146us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:38.710327 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:38.710351 (+ 24us) server_negotiation.cc:407] Connection header received
0806 02:21:38.710431 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:38.710437 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:38.710640 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:38.711166 (+ 526us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:38.711326 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.712077 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.713931 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.714804 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.714934 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.715060 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:38.715157 (+ 97us) server_negotiation.cc:299] Negotiation successful
0806 02:21:38.715257 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1042,"thread_start_us":125,"threads_started":1}
I20260806 02:21:38.715539 22281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.709713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44542 (local address 127.26.189.129:35787)
0806 02:21:38.710113 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:38.710121 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:38.710757 (+ 636us) server_negotiation.cc:407] Connection header received
0806 02:21:38.710841 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:38.710848 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:38.711058 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:38.711229 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:38.711411 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.712498 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.713859 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.714520 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.714662 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.714814 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:38.715298 (+ 484us) server_negotiation.cc:299] Negotiation successful
0806 02:21:38.715414 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":113,"threads_started":1}
I20260806 02:21:38.715637 22280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.709119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:33689 (local address 127.0.0.1:34440)
0806 02:21:38.709880 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:38.709933 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:38.710073 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:38.710943 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:38.710946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:38.710959 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:38.711030 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.711039 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.712519 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.712523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.713860 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.713868 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.715181 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.715185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.715275 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.715299 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 02:21:38.715372 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 02:21:38.715440 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"mutex_wait_us":104,"spinlock_wait_cycles":6784,"thread_start_us":138,"threads_started":1}
I20260806 02:21:38.715998 22283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.709889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34440 (local address 127.26.189.131:33689)
0806 02:21:38.710383 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:38.710400 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:38.710419 (+ 19us) server_negotiation.cc:407] Connection header received
0806 02:21:38.710482 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:38.710486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:38.710639 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:38.710796 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:38.711159 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.712382 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.713983 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.714804 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.714934 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.715060 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:38.715741 (+ 681us) server_negotiation.cc:299] Negotiation successful
0806 02:21:38.715848 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":135,"threads_started":1}
I20260806 02:21:38.715705 22277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.709042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:39739 (local address 127.0.0.1:34118)
0806 02:21:38.709880 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:38.709932 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:38.710072 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:38.710835 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:38.710840 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:38.710863 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:38.710997 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.711006 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.712209 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.712214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.713813 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.713827 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.714935 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.714939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.715022 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.715042 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 02:21:38.715118 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 02:21:38.715175 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"mutex_wait_us":130,"spinlock_wait_cycles":2944,"thread_start_us":87,"threads_started":1}
I20260806 02:21:38.718739 21817 tablet_service.cc:1467] Processing CreateTablet for tablet 4fb286c80eff49008cdb3ddaca767865 (DEFAULT_TABLE table=test-table [id=76953946775e4f478ac77f7ed30b66e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:38.718741 22175 tablet_service.cc:1467] Processing CreateTablet for tablet 4fb286c80eff49008cdb3ddaca767865 (DEFAULT_TABLE table=test-table [id=76953946775e4f478ac77f7ed30b66e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:38.719749 21817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fb286c80eff49008cdb3ddaca767865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:38.719774 22175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fb286c80eff49008cdb3ddaca767865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:38.726254 22284 tablet_bootstrap.cc:492] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a: Bootstrap starting.
I20260806 02:21:38.727164 22285 tablet_bootstrap.cc:492] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7: Bootstrap starting.
I20260806 02:21:38.728413 22284 tablet_bootstrap.cc:654] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:38.728338 22000 tablet_service.cc:1467] Processing CreateTablet for tablet 4fb286c80eff49008cdb3ddaca767865 (DEFAULT_TABLE table=test-table [id=76953946775e4f478ac77f7ed30b66e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:38.729291 22284 log.cc:824] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:38.729334 22285 tablet_bootstrap.cc:654] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:38.729496 22000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fb286c80eff49008cdb3ddaca767865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:38.730895 22285 log.cc:824] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:38.731473 22284 tablet_bootstrap.cc:492] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a: No bootstrap required, opened a new log
I20260806 02:21:38.731716 22284 ts_tablet_manager.cc:1397] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:21:38.733014 22285 tablet_bootstrap.cc:492] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7: No bootstrap required, opened a new log
I20260806 02:21:38.733209 22285 ts_tablet_manager.cc:1397] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260806 02:21:38.736212 22288 tablet_bootstrap.cc:492] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca: Bootstrap starting.
I20260806 02:21:38.736249 22284 raft_consensus.cc:348] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 39739 } } peers { permanent_uuid: "578bf9cb23f64772929808253e3b5bd7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33689 } } peers { permanent_uuid: "104170c6d8a14d0782598b9987bc875a" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 35787 } }
I20260806 02:21:38.736671 22284 raft_consensus.cc:374] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:38.736790 22284 raft_consensus.cc:729] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104170c6d8a14d0782598b9987bc875a, State: Initialized, Role: FOLLOWER
I20260806 02:21:38.737094 22285 raft_consensus.cc:348] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 39739 } } peers { permanent_uuid: "578bf9cb23f64772929808253e3b5bd7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33689 } } peers { permanent_uuid: "104170c6d8a14d0782598b9987bc875a" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 35787 } }
I20260806 02:21:38.737250 22284 consensus_queue.cc:260] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 39739 } } peers { permanent_uuid: "578bf9cb23f64772929808253e3b5bd7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33689 } } peers { permanent_uuid: "104170c6d8a14d0782598b9987bc875a" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 35787 } }
I20260806 02:21:38.737344 22285 raft_consensus.cc:374] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:38.737396 22285 raft_consensus.cc:729] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 578bf9cb23f64772929808253e3b5bd7, State: Initialized, Role: FOLLOWER
I20260806 02:21:38.738052 21907 heartbeater.cc:503] Master 127.26.189.190:33317 was elected leader, sending a full tablet report...
I20260806 02:21:38.738435 22284 ts_tablet_manager.cc:1428] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 02:21:38.738559 22288 tablet_bootstrap.cc:654] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:38.738740 22285 consensus_queue.cc:260] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 39739 } } peers { permanent_uuid: "578bf9cb23f64772929808253e3b5bd7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33689 } } peers { permanent_uuid: "104170c6d8a14d0782598b9987bc875a" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 35787 } }
I20260806 02:21:38.739657 22285 ts_tablet_manager.cc:1428] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:21:38.739840 22288 log.cc:824] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:38.740020 22264 heartbeater.cc:503] Master 127.26.189.190:33317 was elected leader, sending a full tablet report...
I20260806 02:21:38.742197 22288 tablet_bootstrap.cc:492] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca: No bootstrap required, opened a new log
I20260806 02:21:38.742408 22288 ts_tablet_manager.cc:1397] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 02:21:38.745384 22288 raft_consensus.cc:348] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 39739 } } peers { permanent_uuid: "578bf9cb23f64772929808253e3b5bd7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33689 } } peers { permanent_uuid: "104170c6d8a14d0782598b9987bc875a" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 35787 } }
I20260806 02:21:38.745661 22288 raft_consensus.cc:374] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:38.745745 22288 raft_consensus.cc:729] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db2ac3e10cca4f4c9f08387611fd56ca, State: Initialized, Role: FOLLOWER
I20260806 02:21:38.746204 22288 consensus_queue.cc:260] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 39739 } } peers { permanent_uuid: "578bf9cb23f64772929808253e3b5bd7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33689 } } peers { permanent_uuid: "104170c6d8a14d0782598b9987bc875a" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 35787 } }
I20260806 02:21:38.746869 22087 heartbeater.cc:503] Master 127.26.189.190:33317 was elected leader, sending a full tablet report...
I20260806 02:21:38.748016 22288 ts_tablet_manager.cc:1428] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260806 02:21:38.896831 22293 raft_consensus.cc:482] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:21:38.897085 22293 raft_consensus.cc:504] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 39739 } } peers { permanent_uuid: "578bf9cb23f64772929808253e3b5bd7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33689 } } peers { permanent_uuid: "104170c6d8a14d0782598b9987bc875a" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 35787 } }
I20260806 02:21:38.898398 22293 leader_election.cc:288] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 578bf9cb23f64772929808253e3b5bd7 (127.26.189.131:33689), 104170c6d8a14d0782598b9987bc875a (127.26.189.129:35787)
I20260806 02:21:38.903039 22283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.898690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:39483 (local address 127.26.189.131:33689)
0806 02:21:38.898832 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:38.898836 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:38.898921 (+ 85us) server_negotiation.cc:407] Connection header received
0806 02:21:38.899043 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:38.899046 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:38.899089 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:38.899160 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:38.899529 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.900316 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.901933 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.902462 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.902589 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.902642 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:38.902842 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 02:21:38.902921 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 02:21:38.903050 22089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.898590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:33689 (local address 127.26.189.130:39483)
0806 02:21:38.898845 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:38.898861 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:38.898967 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:38.899232 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:38.899237 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:38.899261 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:38.899400 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.899407 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.900426 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.900429 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.901769 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.901780 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.902583 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.902586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.902705 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.902728 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 02:21:38.902807 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 02:21:38.902890 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168}
I20260806 02:21:38.903265 22281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.899122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:48889 (local address 127.26.189.129:35787)
0806 02:21:38.899297 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:38.899302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:38.899494 (+ 192us) server_negotiation.cc:407] Connection header received
0806 02:21:38.899609 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:38.899612 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:38.899662 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:38.899746 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:38.899973 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.900610 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.902028 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.902572 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.902690 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.902741 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:38.903037 (+ 296us) server_negotiation.cc:299] Negotiation successful
0806 02:21:38.903126 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 02:21:38.903614 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.898666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:35787 (local address 127.26.189.130:48889)
0806 02:21:38.899406 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:38.899420 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:38.899515 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:38.899759 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:38.899761 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:38.899775 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:38.899877 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.899881 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.900713 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.900716 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.901919 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:38.901928 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.902814 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.902817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:38.902906 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.902926 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 02:21:38.903403 (+ 477us) client_negotiation.cc:240] Negotiation successful
0806 02:21:38.903484 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"mutex_wait_us":1,"thread_start_us":99,"threads_started":1}
I20260806 02:21:38.903919 22203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb286c80eff49008cdb3ddaca767865" candidate_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "578bf9cb23f64772929808253e3b5bd7" is_pre_election: true
I20260806 02:21:38.904273 22203 raft_consensus.cc:2454] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db2ac3e10cca4f4c9f08387611fd56ca in term 0.
I20260806 02:21:38.904781 21934 leader_election.cc:302] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 578bf9cb23f64772929808253e3b5bd7, db2ac3e10cca4f4c9f08387611fd56ca; no voters:
I20260806 02:21:38.904806 21843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb286c80eff49008cdb3ddaca767865" candidate_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104170c6d8a14d0782598b9987bc875a" is_pre_election: true
I20260806 02:21:38.905059 21843 raft_consensus.cc:2454] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db2ac3e10cca4f4c9f08387611fd56ca in term 0.
I20260806 02:21:38.905083 22293 raft_consensus.cc:2781] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:21:38.905225 22293 raft_consensus.cc:482] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:21:38.905287 22293 raft_consensus.cc:3037] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:38.906625 22293 raft_consensus.cc:504] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 39739 } } peers { permanent_uuid: "578bf9cb23f64772929808253e3b5bd7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33689 } } peers { permanent_uuid: "104170c6d8a14d0782598b9987bc875a" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 35787 } }
W20260806 02:21:38.906847 22267 tablet.cc:2369] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:21:38.907356 22293 leader_election.cc:288] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [CANDIDATE]: Term 1 election: Requested vote from peers 578bf9cb23f64772929808253e3b5bd7 (127.26.189.131:33689), 104170c6d8a14d0782598b9987bc875a (127.26.189.129:35787)
I20260806 02:21:38.907361 22203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb286c80eff49008cdb3ddaca767865" candidate_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "578bf9cb23f64772929808253e3b5bd7"
I20260806 02:21:38.907471 22203 raft_consensus.cc:3037] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:38.908551 22203 raft_consensus.cc:2454] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db2ac3e10cca4f4c9f08387611fd56ca in term 1.
I20260806 02:21:38.908862 21934 leader_election.cc:302] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 578bf9cb23f64772929808253e3b5bd7, db2ac3e10cca4f4c9f08387611fd56ca; no voters:
I20260806 02:21:38.909058 21843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb286c80eff49008cdb3ddaca767865" candidate_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104170c6d8a14d0782598b9987bc875a"
I20260806 02:21:38.909188 21843 raft_consensus.cc:3037] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:38.909613 22293 raft_consensus.cc:2781] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:38.909873 22293 raft_consensus.cc:686] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 1 LEADER]: Becoming Leader. State: Replica: db2ac3e10cca4f4c9f08387611fd56ca, State: Running, Role: LEADER
I20260806 02:21:38.910229 22293 consensus_queue.cc:237] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 39739 } } peers { permanent_uuid: "578bf9cb23f64772929808253e3b5bd7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33689 } } peers { permanent_uuid: "104170c6d8a14d0782598b9987bc875a" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 35787 } }
I20260806 02:21:38.910458 21843 raft_consensus.cc:2454] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db2ac3e10cca4f4c9f08387611fd56ca in term 1.
I20260806 02:21:38.913399 21650 catalog_manager.cc:5495] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca reported cstate change: term changed from 0 to 1, leader changed from <none> to db2ac3e10cca4f4c9f08387611fd56ca (127.26.189.130). New cstate: current_term: 1 leader_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db2ac3e10cca4f4c9f08387611fd56ca" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 39739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "578bf9cb23f64772929808253e3b5bd7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104170c6d8a14d0782598b9987bc875a" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 35787 } health_report { overall_health: UNKNOWN } } }
W20260806 02:21:38.926970 22088 tablet.cc:2369] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 02:21:38.934966 21908 tablet.cc:2369] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:21:38.950981 22279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:38.947606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34130 (local address 127.26.189.130:39739)
0806 02:21:38.947743 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:38.947747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:38.947761 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:21:38.947853 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:38.947855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:38.947913 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:38.948006 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:21:38.948235 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.948752 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.949607 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:38.949834 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:38.949915 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:38.950195 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:21:38.950639 (+ 444us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:21:38.950731 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:38.950790 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 02:21:38.950842 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 02:21:38.957113 21843 raft_consensus.cc:1261] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a [term 1 FOLLOWER]: Refusing update from remote peer db2ac3e10cca4f4c9f08387611fd56ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:21:38.957144 22203 raft_consensus.cc:1261] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7 [term 1 FOLLOWER]: Refusing update from remote peer db2ac3e10cca4f4c9f08387611fd56ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:21:38.957934 22293 consensus_queue.cc:1035] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "104170c6d8a14d0782598b9987bc875a" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 35787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:21:38.958153 22297 consensus_queue.cc:1035] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "578bf9cb23f64772929808253e3b5bd7" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 33689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:21:38.969028 22305 mvcc.cc:205] Tried to move back new op lower bound from 7315385954120331264 to 7315385953939542016. Current Snapshot: MvccSnapshot[applied={T|T < 7315385954120331264 or (T in {7315385954120331264})}]
I20260806 02:21:38.974443 21653 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:21:38.974599 21653 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:21:38.977005 21653 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6ae720ea77a2490a85c8f4549bbcc0cb: Sending DeleteTablet for 3 replicas of tablet 4fb286c80eff49008cdb3ddaca767865
I20260806 02:21:38.977777 22000 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fb286c80eff49008cdb3ddaca767865 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:38 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:34118
I20260806 02:21:38.977818 22175 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fb286c80eff49008cdb3ddaca767865 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:38 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:34440
I20260806 02:21:38.978204 21817 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fb286c80eff49008cdb3ddaca767865 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:38 UTC) from {username='kudu', principal='kudu/127.26.189.190@KRBTEST.COM'} at 127.0.0.1:44542
I20260806 02:21:38.978680 22321 tablet_replica.cc:330] T 4fb286c80eff49008cdb3ddaca767865 P 104170c6d8a14d0782598b9987bc875a: stopping tablet replica
I20260806 02:21:38.978698 22319 tablet_replica.cc:330] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7: stopping tablet replica
I20260806 02:21:38.978936 22318 tablet_replica.cc:330] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca: stopping tablet replica
I20260806 02:21:38.979106 22319 raft_consensus.cc:2229] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:21:38.979297 22318 raft_consensus.cc:2229] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 1 LEADER]: Raft consensus shutting down.
I20260806 02:21:38.979370 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 21739
I20260806 02:21:38.979492 22319 raft_consensus.cc:2258] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:38.986076 22319 ts_tablet_manager.cc:1905] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:21:38.988912 22319 ts_tablet_manager.cc:1918] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:21:38.989005 22319 log.cc:1196] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/4fb286c80eff49008cdb3ddaca767865
I20260806 02:21:38.989346 22319 ts_tablet_manager.cc:1939] T 4fb286c80eff49008cdb3ddaca767865 P 578bf9cb23f64772929808253e3b5bd7: Deleting consensus metadata
I20260806 02:21:38.992012 21630 catalog_manager.cc:4841] TS 578bf9cb23f64772929808253e3b5bd7 (127.26.189.131:33689): tablet 4fb286c80eff49008cdb3ddaca767865 (table test-table [id=76953946775e4f478ac77f7ed30b66e5]) successfully deleted
I20260806 02:21:38.992802 22318 raft_consensus.cc:2258] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:38.994402 22318 ts_tablet_manager.cc:1905] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:21:38.996513 22318 ts_tablet_manager.cc:1918] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:21:38.996641 22318 log.cc:1196] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/4fb286c80eff49008cdb3ddaca767865
I20260806 02:21:38.996951 22318 ts_tablet_manager.cc:1939] T 4fb286c80eff49008cdb3ddaca767865 P db2ac3e10cca4f4c9f08387611fd56ca: Deleting consensus metadata
I20260806 02:21:38.998204 21629 catalog_manager.cc:4841] TS db2ac3e10cca4f4c9f08387611fd56ca (127.26.189.130:39739): tablet 4fb286c80eff49008cdb3ddaca767865 (table test-table [id=76953946775e4f478ac77f7ed30b66e5]) successfully deleted
W20260806 02:21:38.999562 21628 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:35787 (error 108)
I20260806 02:21:38.999835 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 21913
I20260806 02:21:39.004839 22278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.004435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:35787 (local address 127.0.0.1:44550)
0806 02:21:39.004665 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:39.004739 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:35787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
W20260806 02:21:39.005000 21628 catalog_manager.cc:4584] TS 104170c6d8a14d0782598b9987bc875a (127.26.189.129:35787): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4fb286c80eff49008cdb3ddaca767865: Network error: Client connection negotiation failed: client connection to 127.26.189.129:35787: connect: Connection refused (error 111)
I20260806 02:21:39.012609 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 22093
I20260806 02:21:39.025864 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 21608
2026-08-06T02:21:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2696 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T02:21:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:39Z Disabled control of system clock
I20260806 02:21:39.062721 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:35881
--webserver_interface=127.26.189.190
--webserver_port=0
--builtin_ntp_servers=127.26.189.148:34861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:35881
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 02:21:39.187791 22326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:39.188246 22326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:39.188395 22326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:39.193713 22326 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:39.193784 22326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:39.193802 22326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:39.193819 22326 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:39.193874 22326 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:39.200374 22326 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:35881
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:35881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:39.201723 22326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:39.203263 22326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:39.212291 22337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:39.212369 22333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:39.212299 22331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:39.212536 22326 server_base.cc:1034] running on GCE node
I20260806 02:21:39.213265 22326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:39.214421 22326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:39.215610 22326 hybrid_clock.cc:648] HybridClock initialized: now 1785982899215597 us; error 26 us; skew 500 ppm
I20260806 02:21:39.222159 22326 webserver.cc:460] Webserver started at http://127.26.189.190:35787/ using document root <none> and password file <none>
I20260806 02:21:39.222780 22326 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:39.222878 22326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:39.223122 22326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:39.225227 22326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "4b7b9c3c312741fab261f9f7c3fba218"
format_stamp: "Formatted at 2026-08-06 02:21:39 on dist-test-slave-gkw7"
server_key: "03a42d109e20ae32f55597eb38772549"
server_key_iv: "6f290e911baa38f3cffb900684aa982b"
server_key_version: "encryptionkey@0"
I20260806 02:21:39.225835 22326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "4b7b9c3c312741fab261f9f7c3fba218"
format_stamp: "Formatted at 2026-08-06 02:21:39 on dist-test-slave-gkw7"
server_key: "03a42d109e20ae32f55597eb38772549"
server_key_iv: "6f290e911baa38f3cffb900684aa982b"
server_key_version: "encryptionkey@0"
I20260806 02:21:39.229650 22326 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 02:21:39.232286 22343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:39.233672 22326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:21:39.233831 22326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "4b7b9c3c312741fab261f9f7c3fba218"
format_stamp: "Formatted at 2026-08-06 02:21:39 on dist-test-slave-gkw7"
server_key: "03a42d109e20ae32f55597eb38772549"
server_key_iv: "6f290e911baa38f3cffb900684aa982b"
server_key_version: "encryptionkey@0"
I20260806 02:21:39.233947 22326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:39.265475 22326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:39.266418 22326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:39.266664 22326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:39.275179 22326 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:35881
I20260806 02:21:39.275179 22409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:35881 every 8 connection(s)
I20260806 02:21:39.276360 22326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:39.280203 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 22326
I20260806 02:21:39.280357 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:39.280725 27382 external_mini_cluster.cc:1428] Setting key 298e073ab40a8418df7fbdc1125d0f63
I20260806 02:21:39.281081 22410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:39.289640 22410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218: Bootstrap starting.
I20260806 02:21:39.292697 22410 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:39.293682 22413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.282972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47750 (local address 127.26.189.190:35881)
0806 02:21:39.283939 (+ 967us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:39.283963 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:39.284014 (+ 51us) server_negotiation.cc:407] Connection header received
0806 02:21:39.285182 (+ 1168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:39.285211 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:39.285831 (+ 620us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:39.286253 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:39.286757 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.288495 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.289409 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.290242 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.290421 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.291282 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:39.291290 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:39.291309 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:39.291878 (+ 569us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:39.291959 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:39.291990 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:39.292101 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:39.292217 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 02:21:39.292520 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":488,"thread_start_us":231,"threads_started":1}
I20260806 02:21:39.293720 22410 log.cc:824] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:39.295993 22410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218: No bootstrap required, opened a new log
I20260806 02:21:39.300067 22410 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b7b9c3c312741fab261f9f7c3fba218" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35881 } }
I20260806 02:21:39.300323 22410 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:39.300362 22410 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7b9c3c312741fab261f9f7c3fba218, State: Initialized, Role: FOLLOWER
I20260806 02:21:39.300761 22410 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b7b9c3c312741fab261f9f7c3fba218" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35881 } }
I20260806 02:21:39.300890 22410 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:39.300941 22410 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:39.301023 22410 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:39.302150 22410 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b7b9c3c312741fab261f9f7c3fba218" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35881 } }
I20260806 02:21:39.302573 22410 leader_election.cc:302] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b7b9c3c312741fab261f9f7c3fba218; no voters:
I20260806 02:21:39.303004 22410 leader_election.cc:288] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:39.303092 22415 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:39.303318 22415 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7b9c3c312741fab261f9f7c3fba218, State: Running, Role: LEADER
I20260806 02:21:39.303725 22415 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b7b9c3c312741fab261f9f7c3fba218" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35881 } }
I20260806 02:21:39.304508 22410 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:39.305637 22416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b7b9c3c312741fab261f9f7c3fba218. Latest consensus state: current_term: 1 leader_uuid: "4b7b9c3c312741fab261f9f7c3fba218" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b7b9c3c312741fab261f9f7c3fba218" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35881 } } }
I20260806 02:21:39.305773 22416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:39.306082 22417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b7b9c3c312741fab261f9f7c3fba218" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b7b9c3c312741fab261f9f7c3fba218" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35881 } } }
I20260806 02:21:39.306202 22426 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:39.306209 22417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:39.309863 22426 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:39.315899 22426 catalog_manager.cc:1347] Generated new cluster ID: ad762896b4854af1856f56ed85c9bca1
I20260806 02:21:39.315979 22426 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:39.331992 22426 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:39.333007 22426 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:39.338027 22426 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218: Generated new TSK 0
I20260806 02:21:39.338872 22426 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:39.352830 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.129:0
--local_ip_for_outbound_sockets=127.26.189.129
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:35881
--builtin_ntp_servers=127.26.189.148:34861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 02:21:39.472242 22438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:39.472498 22438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:39.472539 22438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:39.476619 22438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:39.476679 22438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:39.476735 22438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.129
I20260806 02:21:39.481791 22438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.189.129
--webserver_port=0
--tserver_master_addrs=127.26.189.190:35881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.129
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:39.482968 22438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:39.484453 22438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:39.494503 22447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:39.494490 22443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:39.494556 22438 server_base.cc:1034] running on GCE node
W20260806 02:21:39.494495 22450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:39.495193 22438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:39.495888 22438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:39.497057 22438 hybrid_clock.cc:648] HybridClock initialized: now 1785982899497035 us; error 29 us; skew 500 ppm
I20260806 02:21:39.499015 22438 webserver.cc:460] Webserver started at http://127.26.189.129:45965/ using document root <none> and password file <none>
I20260806 02:21:39.499606 22438 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:39.499720 22438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:39.499964 22438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:39.502184 22438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/data/instance:
uuid: "51f9cfcee4c44b1099a22be3ff5c0c91"
format_stamp: "Formatted at 2026-08-06 02:21:39 on dist-test-slave-gkw7"
server_key: "85962173b0cb6b6b6df230a8c4d5d4cf"
server_key_iv: "392112595a632c6047fce194a607d0a3"
server_key_version: "encryptionkey@0"
I20260806 02:21:39.502779 22438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance:
uuid: "51f9cfcee4c44b1099a22be3ff5c0c91"
format_stamp: "Formatted at 2026-08-06 02:21:39 on dist-test-slave-gkw7"
server_key: "85962173b0cb6b6b6df230a8c4d5d4cf"
server_key_iv: "392112595a632c6047fce194a607d0a3"
server_key_version: "encryptionkey@0"
I20260806 02:21:39.506814 22438 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:21:39.509292 22456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:39.510571 22438 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:21:39.510726 22438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/wal
uuid: "51f9cfcee4c44b1099a22be3ff5c0c91"
format_stamp: "Formatted at 2026-08-06 02:21:39 on dist-test-slave-gkw7"
server_key: "85962173b0cb6b6b6df230a8c4d5d4cf"
server_key_iv: "392112595a632c6047fce194a607d0a3"
server_key_version: "encryptionkey@0"
I20260806 02:21:39.510845 22438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:39.524996 22438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:39.525790 22438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:39.526006 22438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:39.526630 22438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:39.527592 22438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:39.527666 22438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:39.527736 22438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:39.527781 22438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:39.536887 22438 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.129:39569
I20260806 02:21:39.536926 22613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.129:39569 every 8 connection(s)
I20260806 02:21:39.537950 22438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/data/info.pb
I20260806 02:21:39.540565 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 22438
I20260806 02:21:39.540712 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-0/wal/instance
I20260806 02:21:39.541038 27382 external_mini_cluster.cc:1428] Setting key afbc0b599ae1414147d81a82eefffee5
I20260806 02:21:39.543421 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.130:0
--local_ip_for_outbound_sockets=127.26.189.130
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:35881
--builtin_ntp_servers=127.26.189.148:34861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 02:21:39.548604 22413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.539821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:35139 (local address 127.26.189.190:35881)
0806 02:21:39.539960 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:39.539965 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:39.541279 (+ 1314us) server_negotiation.cc:407] Connection header received
0806 02:21:39.543048 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:39.543051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:39.543092 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:39.543156 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:39.544388 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.544929 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.546287 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.546655 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.546750 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.548092 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:39.548095 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:39.548097 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:39.548110 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:39.548127 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:39.548135 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:39.548198 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:39.548414 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 02:21:39.548489 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 02:21:39.549938 22617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.540252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:35881 (local address 127.26.189.129:35139)
0806 02:21:39.541087 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:39.541149 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:39.542822 (+ 1673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:39.543370 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:39.543379 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:39.543492 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:39.544226 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:39.544247 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.545083 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.545089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:39.546156 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:39.546166 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.546841 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.546848 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:39.547087 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.547770 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:21:39.547774 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:39.547830 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:21:39.547917 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:39.548222 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:39.548235 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:39.548244 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 02:21:39.548389 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 02:21:39.548732 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":127,"threads_started":1}
I20260806 02:21:39.551287 22614 heartbeater.cc:347] Connected to a master server at 127.26.189.190:35881
I20260806 02:21:39.551549 22614 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:39.552160 22614 heartbeater.cc:511] Master 127.26.189.190:35881 requested a full tablet report, sending...
I20260806 02:21:39.553809 22363 ts_manager.cc:194] Registered new tserver with Master: 51f9cfcee4c44b1099a22be3ff5c0c91 (127.26.189.129:39569)
I20260806 02:21:39.555094 22363 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.189.129:35139
W20260806 02:21:39.660517 22619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:39.660777 22619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:39.660815 22619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:39.664881 22619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:39.664942 22619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:39.664997 22619 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.130
I20260806 02:21:39.669757 22619 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.189.130
--webserver_port=0
--tserver_master_addrs=127.26.189.190:35881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.130
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:39.670869 22619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:39.672338 22619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:39.682403 22628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:39.682416 22631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:39.682478 22619 server_base.cc:1034] running on GCE node
W20260806 02:21:39.682399 22627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:39.683168 22619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:39.683892 22619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:39.685261 22619 hybrid_clock.cc:648] HybridClock initialized: now 1785982899685239 us; error 34 us; skew 500 ppm
I20260806 02:21:39.687237 22619 webserver.cc:460] Webserver started at http://127.26.189.130:39199/ using document root <none> and password file <none>
I20260806 02:21:39.687866 22619 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:39.687963 22619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:39.688180 22619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:39.690582 22619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/data/instance:
uuid: "ae4ca69408494bed9c175d20b9e8de3c"
format_stamp: "Formatted at 2026-08-06 02:21:39 on dist-test-slave-gkw7"
server_key: "c9119fd55157be607020f68b7d6c9bfc"
server_key_iv: "19822651a978f8bcbb70e0531f924930"
server_key_version: "encryptionkey@0"
I20260806 02:21:39.691219 22619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance:
uuid: "ae4ca69408494bed9c175d20b9e8de3c"
format_stamp: "Formatted at 2026-08-06 02:21:39 on dist-test-slave-gkw7"
server_key: "c9119fd55157be607020f68b7d6c9bfc"
server_key_iv: "19822651a978f8bcbb70e0531f924930"
server_key_version: "encryptionkey@0"
I20260806 02:21:39.695051 22619 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:21:39.697649 22640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:39.698943 22619 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 02:21:39.699080 22619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/wal
uuid: "ae4ca69408494bed9c175d20b9e8de3c"
format_stamp: "Formatted at 2026-08-06 02:21:39 on dist-test-slave-gkw7"
server_key: "c9119fd55157be607020f68b7d6c9bfc"
server_key_iv: "19822651a978f8bcbb70e0531f924930"
server_key_version: "encryptionkey@0"
I20260806 02:21:39.699199 22619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:39.717221 22619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:39.718026 22619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:39.718238 22619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:39.718868 22619 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:39.719863 22619 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:39.719936 22619 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:39.720009 22619 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:39.720060 22619 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:39.729760 22619 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.130:45393
I20260806 02:21:39.729795 22794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.130:45393 every 8 connection(s)
I20260806 02:21:39.730708 22619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/data/info.pb
I20260806 02:21:39.731805 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 22619
I20260806 02:21:39.731969 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/wal/instance
I20260806 02:21:39.732357 27382 external_mini_cluster.cc:1428] Setting key e33bb5ff7b7d944a5a0adca15746b1d6
I20260806 02:21:39.734819 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.189.131:0
--local_ip_for_outbound_sockets=127.26.189.131
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:35881
--builtin_ntp_servers=127.26.189.148:34861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 02:21:39.742568 22413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.732878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.130:53499 (local address 127.26.189.190:35881)
0806 02:21:39.733070 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:39.733075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:39.734480 (+ 1405us) server_negotiation.cc:407] Connection header received
0806 02:21:39.736770 (+ 2290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:39.736773 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:39.736819 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:39.736923 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:39.738069 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.738902 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.740095 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.740572 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.740723 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.741904 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:39.741912 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:39.741917 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:39.741937 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:39.741965 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:39.741980 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:39.742081 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:39.742242 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 02:21:39.742331 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 02:21:39.743310 22797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.733378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:35881 (local address 127.26.189.130:53499)
0806 02:21:39.734302 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:39.734366 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:39.736493 (+ 2127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:39.737137 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:39.737147 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:39.737259 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:39.737911 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:39.737927 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.739043 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.739046 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:39.739955 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:39.739965 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.740740 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.740743 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:39.740909 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.741613 (+ 704us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:21:39.741614 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:39.741657 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:21:39.741722 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:39.742077 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:39.742084 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:39.742088 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 02:21:39.742179 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 02:21:39.742412 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":233,"threads_started":1}
I20260806 02:21:39.744571 22795 heartbeater.cc:347] Connected to a master server at 127.26.189.190:35881
I20260806 02:21:39.744882 22795 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:39.745697 22795 heartbeater.cc:511] Master 127.26.189.190:35881 requested a full tablet report, sending...
I20260806 02:21:39.746996 22363 ts_manager.cc:194] Registered new tserver with Master: ae4ca69408494bed9c175d20b9e8de3c (127.26.189.130:45393)
I20260806 02:21:39.747576 22363 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.189.130:53499
W20260806 02:21:39.856146 22798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:39.856416 22798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:39.856454 22798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:39.860474 22798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:39.860531 22798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:39.860623 22798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.189.131
I20260806 02:21:39.865391 22798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:34861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.189.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.189.131
--webserver_port=0
--tserver_master_addrs=127.26.189.190:35881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.189.131
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:39.866501 22798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:39.867940 22798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:39.877642 22810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:39.877626 22805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:39.877808 22798 server_base.cc:1034] running on GCE node
W20260806 02:21:39.877626 22806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:39.878405 22798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:39.879060 22798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:39.880246 22798 hybrid_clock.cc:648] HybridClock initialized: now 1785982899880232 us; error 37 us; skew 500 ppm
I20260806 02:21:39.882207 22798 webserver.cc:460] Webserver started at http://127.26.189.131:38297/ using document root <none> and password file <none>
I20260806 02:21:39.882822 22798 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:39.882921 22798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:39.883169 22798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:39.885197 22798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/data/instance:
uuid: "10c7d196d3f84bab831fe4d8aefe983b"
format_stamp: "Formatted at 2026-08-06 02:21:39 on dist-test-slave-gkw7"
server_key: "a8f9d1cd698eb4fd3186f362d53d10cf"
server_key_iv: "0ddbeb3c6f3b072b1883f6d065bfdcd8"
server_key_version: "encryptionkey@0"
I20260806 02:21:39.885784 22798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance:
uuid: "10c7d196d3f84bab831fe4d8aefe983b"
format_stamp: "Formatted at 2026-08-06 02:21:39 on dist-test-slave-gkw7"
server_key: "a8f9d1cd698eb4fd3186f362d53d10cf"
server_key_iv: "0ddbeb3c6f3b072b1883f6d065bfdcd8"
server_key_version: "encryptionkey@0"
I20260806 02:21:39.889485 22798 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:21:39.892072 22817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:39.893335 22798 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:39.893479 22798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/wal
uuid: "10c7d196d3f84bab831fe4d8aefe983b"
format_stamp: "Formatted at 2026-08-06 02:21:39 on dist-test-slave-gkw7"
server_key: "a8f9d1cd698eb4fd3186f362d53d10cf"
server_key_iv: "0ddbeb3c6f3b072b1883f6d065bfdcd8"
server_key_version: "encryptionkey@0"
I20260806 02:21:39.893640 22798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:39.916059 22798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:39.916803 22798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:39.917009 22798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:39.917701 22798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 02:21:39.918680 22798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 02:21:39.918751 22798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:39.918818 22798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 02:21:39.918861 22798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:39.928586 22798 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.131:41241
I20260806 02:21:39.928612 22964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.131:41241 every 8 connection(s)
I20260806 02:21:39.929579 22798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/data/info.pb
I20260806 02:21:39.933774 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 22798
I20260806 02:21:39.933930 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/wal/instance
I20260806 02:21:39.934268 27382 external_mini_cluster.cc:1428] Setting key 82d3fbe743a49ed71bacd948ff173ae5
I20260806 02:21:39.939553 22413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.931463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.131:42291 (local address 127.26.189.190:35881)
0806 02:21:39.931608 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:39.931612 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:39.932714 (+ 1102us) server_negotiation.cc:407] Connection header received
0806 02:21:39.934410 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:39.934413 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:39.934464 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:39.934541 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:39.935689 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.936439 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.937797 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.938014 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.938098 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.939147 (+ 1049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:39.939150 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:39.939152 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:39.939164 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:39.939183 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:39.939191 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:39.939252 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:39.939391 (+ 139us) server_negotiation.cc:299] Negotiation successful
0806 02:21:39.939443 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 02:21:39.940429 22968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.931830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:35881 (local address 127.26.189.131:42291)
0806 02:21:39.932556 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:39.932598 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:39.934167 (+ 1569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:39.934746 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:39.934759 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:39.934844 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:21:39.935512 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:39.935534 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.936569 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.936572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:39.937685 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:39.937695 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.938162 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.938165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:39.938340 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.938903 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 02:21:39.938904 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:21:39.938943 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 02:21:39.939004 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:21:39.939268 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:21:39.939275 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:21:39.939279 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 02:21:39.939375 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 02:21:39.939593 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":118,"threads_started":1}
I20260806 02:21:39.941474 22965 heartbeater.cc:347] Connected to a master server at 127.26.189.190:35881
I20260806 02:21:39.941769 22965 heartbeater.cc:464] Registering TS with master...
I20260806 02:21:39.942305 22965 heartbeater.cc:511] Master 127.26.189.190:35881 requested a full tablet report, sending...
I20260806 02:21:39.943328 22363 ts_manager.cc:194] Registered new tserver with Master: 10c7d196d3f84bab831fe4d8aefe983b (127.26.189.131:41241)
I20260806 02:21:39.943849 22363 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.189.131:42291
I20260806 02:21:39.948319 27382 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 02:21:39.954094 22413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.950392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47758 (local address 127.26.189.190:35881)
0806 02:21:39.950535 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:39.950541 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:39.950688 (+ 147us) server_negotiation.cc:407] Connection header received
0806 02:21:39.950782 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:39.950784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:39.950821 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:39.950886 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:39.951152 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.951651 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.952472 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.952690 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.952772 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.953547 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:39.953553 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:39.953555 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:39.953568 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:39.953589 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:39.953598 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:39.953694 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:39.953775 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 02:21:39.953826 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 02:21:39.957213 22363 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47758:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 02:21:39.960641 22363 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 02:21:39.976069 22983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.969368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:39569 (local address 127.0.0.1:54896)
0806 02:21:39.969988 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:39.970047 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:39.970195 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:39.971455 (+ 1260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:39.971461 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:39.971484 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:39.971587 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:39.971595 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.972906 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.972910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:39.974374 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:39.974385 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.975397 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.975401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:39.975519 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.975559 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 02:21:39.975694 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 02:21:39.975836 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"mutex_wait_us":116,"thread_start_us":98,"threads_started":1}
I20260806 02:21:39.976056 22986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.969574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54896 (local address 127.26.189.129:39569)
0806 02:21:39.970889 (+ 1315us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:39.970903 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:39.970934 (+ 31us) server_negotiation.cc:407] Connection header received
0806 02:21:39.971020 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:39.971026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:39.971240 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:39.971470 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:39.971712 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.972731 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.974515 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.975254 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.975410 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.975617 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:39.975740 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 02:21:39.975847 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1198,"thread_start_us":131,"threads_started":1}
I20260806 02:21:39.976495 22984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.970102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:41241 (local address 127.0.0.1:37348)
0806 02:21:39.970861 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:39.970875 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:39.970959 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:39.971677 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:39.971681 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:39.971703 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:39.971824 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:39.971832 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.973184 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.973187 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:39.974641 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:39.974652 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.975997 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.976001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:39.976102 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.976179 (+ 77us) client_negotiation.cc:769] Sending connection context
0806 02:21:39.976254 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 02:21:39.976345 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"mutex_wait_us":87,"thread_start_us":111,"threads_started":1}
I20260806 02:21:39.976854 22989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.970238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52332 (local address 127.26.189.130:45393)
0806 02:21:39.970689 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:39.970703 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:39.970729 (+ 26us) server_negotiation.cc:407] Connection header received
0806 02:21:39.970828 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:39.970833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:39.971055 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:39.971227 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:39.971557 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.972752 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.974793 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.975588 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.975710 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.975876 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:39.976565 (+ 689us) server_negotiation.cc:299] Negotiation successful
0806 02:21:39.976679 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":131,"threads_started":1}
I20260806 02:21:39.977078 22990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.970624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37348 (local address 127.26.189.131:41241)
0806 02:21:39.971062 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:39.971074 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:39.971094 (+ 20us) server_negotiation.cc:407] Connection header received
0806 02:21:39.971166 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:39.971170 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:39.971340 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:39.971486 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:39.971969 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.973059 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.974799 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.975588 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.975710 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.975917 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:39.976789 (+ 872us) server_negotiation.cc:299] Negotiation successful
0806 02:21:39.976898 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":135,"threads_started":1}
I20260806 02:21:39.976495 22988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:39.969505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:45393 (local address 127.0.0.1:52332)
0806 02:21:39.970498 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:39.970515 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:39.970608 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:39.971217 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:39.971223 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:39.971245 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:39.971398 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:39.971424 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.972886 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.972889 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:39.974641 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:39.974652 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:39.975974 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:39.975979 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:39.976099 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:39.976279 (+ 180us) client_negotiation.cc:769] Sending connection context
0806 02:21:39.976339 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 02:21:39.976393 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":920,"mutex_wait_us":297,"thread_start_us":111,"threads_started":1}
I20260806 02:21:39.979532 22518 tablet_service.cc:1467] Processing CreateTablet for tablet ffb2bcf41e174a5da33cedd1a3029b67 (DEFAULT_TABLE table=test-table [id=05e0054921ef40cbb54faa9337c40fde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:39.980589 22518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffb2bcf41e174a5da33cedd1a3029b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:39.980170 22708 tablet_service.cc:1467] Processing CreateTablet for tablet ffb2bcf41e174a5da33cedd1a3029b67 (DEFAULT_TABLE table=test-table [id=05e0054921ef40cbb54faa9337c40fde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:39.981365 22708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffb2bcf41e174a5da33cedd1a3029b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:39.983035 22880 tablet_service.cc:1467] Processing CreateTablet for tablet ffb2bcf41e174a5da33cedd1a3029b67 (DEFAULT_TABLE table=test-table [id=05e0054921ef40cbb54faa9337c40fde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 02:21:39.984205 22880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffb2bcf41e174a5da33cedd1a3029b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:39.987440 22991 tablet_bootstrap.cc:492] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91: Bootstrap starting.
I20260806 02:21:39.989369 22992 tablet_bootstrap.cc:492] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c: Bootstrap starting.
I20260806 02:21:39.990010 22991 tablet_bootstrap.cc:654] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:39.990953 22991 log.cc:824] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:39.991649 22992 tablet_bootstrap.cc:654] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:39.991698 22993 tablet_bootstrap.cc:492] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b: Bootstrap starting.
I20260806 02:21:39.992743 22992 log.cc:824] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:39.994110 22993 tablet_bootstrap.cc:654] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:39.994143 22991 tablet_bootstrap.cc:492] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91: No bootstrap required, opened a new log
I20260806 02:21:39.994360 22991 ts_tablet_manager.cc:1397] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 02:21:39.994652 22992 tablet_bootstrap.cc:492] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c: No bootstrap required, opened a new log
I20260806 02:21:39.994865 22992 ts_tablet_manager.cc:1397] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 02:21:39.995069 22993 log.cc:824] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:39.997371 22993 tablet_bootstrap.cc:492] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b: No bootstrap required, opened a new log
I20260806 02:21:39.997602 22993 ts_tablet_manager.cc:1397] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:21:39.998692 22992 raft_consensus.cc:348] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39569 } } peers { permanent_uuid: "ae4ca69408494bed9c175d20b9e8de3c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45393 } } peers { permanent_uuid: "10c7d196d3f84bab831fe4d8aefe983b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 41241 } }
I20260806 02:21:39.999010 22992 raft_consensus.cc:374] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:39.999099 22992 raft_consensus.cc:729] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ca69408494bed9c175d20b9e8de3c, State: Initialized, Role: FOLLOWER
I20260806 02:21:39.999579 22992 consensus_queue.cc:260] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39569 } } peers { permanent_uuid: "ae4ca69408494bed9c175d20b9e8de3c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45393 } } peers { permanent_uuid: "10c7d196d3f84bab831fe4d8aefe983b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 41241 } }
I20260806 02:21:39.999446 22991 raft_consensus.cc:348] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39569 } } peers { permanent_uuid: "ae4ca69408494bed9c175d20b9e8de3c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45393 } } peers { permanent_uuid: "10c7d196d3f84bab831fe4d8aefe983b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 41241 } }
I20260806 02:21:39.999725 22991 raft_consensus.cc:374] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:39.999818 22991 raft_consensus.cc:729] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f9cfcee4c44b1099a22be3ff5c0c91, State: Initialized, Role: FOLLOWER
I20260806 02:21:40.000308 22991 consensus_queue.cc:260] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39569 } } peers { permanent_uuid: "ae4ca69408494bed9c175d20b9e8de3c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45393 } } peers { permanent_uuid: "10c7d196d3f84bab831fe4d8aefe983b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 41241 } }
I20260806 02:21:40.000571 22992 ts_tablet_manager.cc:1428] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 02:21:40.001012 22614 heartbeater.cc:503] Master 127.26.189.190:35881 was elected leader, sending a full tablet report...
I20260806 02:21:40.001012 22795 heartbeater.cc:503] Master 127.26.189.190:35881 was elected leader, sending a full tablet report...
I20260806 02:21:40.001340 22991 ts_tablet_manager.cc:1428] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 02:21:40.002298 22993 raft_consensus.cc:348] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39569 } } peers { permanent_uuid: "ae4ca69408494bed9c175d20b9e8de3c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45393 } } peers { permanent_uuid: "10c7d196d3f84bab831fe4d8aefe983b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 41241 } }
I20260806 02:21:40.002579 22993 raft_consensus.cc:374] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:40.002666 22993 raft_consensus.cc:729] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c7d196d3f84bab831fe4d8aefe983b, State: Initialized, Role: FOLLOWER
I20260806 02:21:40.003101 22993 consensus_queue.cc:260] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39569 } } peers { permanent_uuid: "ae4ca69408494bed9c175d20b9e8de3c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45393 } } peers { permanent_uuid: "10c7d196d3f84bab831fe4d8aefe983b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 41241 } }
I20260806 02:21:40.003861 22965 heartbeater.cc:503] Master 127.26.189.190:35881 was elected leader, sending a full tablet report...
I20260806 02:21:40.004191 22993 ts_tablet_manager.cc:1428] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260806 02:21:40.039203 22615 tablet.cc:2369] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:21:40.163249 22998 raft_consensus.cc:482] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 02:21:40.163475 22998 raft_consensus.cc:504] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39569 } } peers { permanent_uuid: "ae4ca69408494bed9c175d20b9e8de3c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45393 } } peers { permanent_uuid: "10c7d196d3f84bab831fe4d8aefe983b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 41241 } }
I20260806 02:21:40.164654 22998 leader_election.cc:288] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ca69408494bed9c175d20b9e8de3c (127.26.189.130:45393), 10c7d196d3f84bab831fe4d8aefe983b (127.26.189.131:41241)
I20260806 02:21:40.168624 22989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:40.165128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:46839 (local address 127.26.189.130:45393)
0806 02:21:40.165360 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:40.165367 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:40.165389 (+ 22us) server_negotiation.cc:407] Connection header received
0806 02:21:40.165615 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:40.165618 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:40.165662 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:40.165751 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:40.166033 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:40.166544 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:40.167657 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:40.168047 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:40.168203 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:40.168257 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:40.168426 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 02:21:40.168500 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260806 02:21:40.168644 23000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:40.164966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.130:45393 (local address 127.26.189.129:46839)
0806 02:21:40.165326 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:40.165339 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:40.165438 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:40.165770 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:40.165773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:40.165792 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:40.165917 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:40.165923 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:40.166671 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:40.166676 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:40.167531 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:40.167540 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:40.168187 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:40.168191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:40.168295 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:40.168319 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 02:21:40.168409 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 02:21:40.168480 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":23,"thread_start_us":123,"threads_started":1}
I20260806 02:21:40.168821 22990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:40.165111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.189.129:59155 (local address 127.26.189.131:41241)
0806 02:21:40.165252 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:40.165257 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:40.165698 (+ 441us) server_negotiation.cc:407] Connection header received
0806 02:21:40.165872 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:40.165875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:40.165913 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:40.166001 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 02:21:40.166268 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:40.166769 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:40.167817 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:40.168256 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:40.168395 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:40.168442 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:40.168626 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 02:21:40.168694 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:21:40.168843 23001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:40.164966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.131:41241 (local address 127.26.189.129:59155)
0806 02:21:40.165606 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:40.165619 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:21:40.165743 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:21:40.166013 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:21:40.166017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:21:40.166032 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 02:21:40.166160 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:40.166165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:40.166885 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:40.166888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:40.167694 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:21:40.167703 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:21:40.168395 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:21:40.168399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:21:40.168494 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:40.168517 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 02:21:40.168611 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 02:21:40.168678 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":320,"thread_start_us":62,"threads_started":1}
I20260806 02:21:40.169513 22737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb2bcf41e174a5da33cedd1a3029b67" candidate_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ca69408494bed9c175d20b9e8de3c" is_pre_election: true
I20260806 02:21:40.169607 22907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb2bcf41e174a5da33cedd1a3029b67" candidate_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c7d196d3f84bab831fe4d8aefe983b" is_pre_election: true
I20260806 02:21:40.169899 22737 raft_consensus.cc:2454] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f9cfcee4c44b1099a22be3ff5c0c91 in term 0.
I20260806 02:21:40.169915 22907 raft_consensus.cc:2454] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f9cfcee4c44b1099a22be3ff5c0c91 in term 0.
I20260806 02:21:40.170436 22462 leader_election.cc:302] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c7d196d3f84bab831fe4d8aefe983b, 51f9cfcee4c44b1099a22be3ff5c0c91; no voters:
I20260806 02:21:40.170766 22998 raft_consensus.cc:2781] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 02:21:40.170846 22998 raft_consensus.cc:482] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 02:21:40.170877 22998 raft_consensus.cc:3037] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:40.172000 22998 raft_consensus.cc:504] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39569 } } peers { permanent_uuid: "ae4ca69408494bed9c175d20b9e8de3c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45393 } } peers { permanent_uuid: "10c7d196d3f84bab831fe4d8aefe983b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 41241 } }
I20260806 02:21:40.172398 22998 leader_election.cc:288] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [CANDIDATE]: Term 1 election: Requested vote from peers ae4ca69408494bed9c175d20b9e8de3c (127.26.189.130:45393), 10c7d196d3f84bab831fe4d8aefe983b (127.26.189.131:41241)
I20260806 02:21:40.172750 22737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb2bcf41e174a5da33cedd1a3029b67" candidate_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ca69408494bed9c175d20b9e8de3c"
I20260806 02:21:40.172783 22907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffb2bcf41e174a5da33cedd1a3029b67" candidate_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c7d196d3f84bab831fe4d8aefe983b"
I20260806 02:21:40.172884 22737 raft_consensus.cc:3037] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:40.172906 22907 raft_consensus.cc:3037] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:40.173982 22737 raft_consensus.cc:2454] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f9cfcee4c44b1099a22be3ff5c0c91 in term 1.
I20260806 02:21:40.174016 22907 raft_consensus.cc:2454] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f9cfcee4c44b1099a22be3ff5c0c91 in term 1.
I20260806 02:21:40.174341 22460 leader_election.cc:302] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f9cfcee4c44b1099a22be3ff5c0c91, ae4ca69408494bed9c175d20b9e8de3c; no voters:
I20260806 02:21:40.174520 22998 raft_consensus.cc:2781] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:40.174790 22998 raft_consensus.cc:686] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [term 1 LEADER]: Becoming Leader. State: Replica: 51f9cfcee4c44b1099a22be3ff5c0c91, State: Running, Role: LEADER
I20260806 02:21:40.175158 22998 consensus_queue.cc:237] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39569 } } peers { permanent_uuid: "ae4ca69408494bed9c175d20b9e8de3c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45393 } } peers { permanent_uuid: "10c7d196d3f84bab831fe4d8aefe983b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 41241 } }
I20260806 02:21:40.178395 22363 catalog_manager.cc:5495] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f9cfcee4c44b1099a22be3ff5c0c91 (127.26.189.129). New cstate: current_term: 1 leader_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f9cfcee4c44b1099a22be3ff5c0c91" member_type: VOTER last_known_addr { host: "127.26.189.129" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae4ca69408494bed9c175d20b9e8de3c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45393 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c7d196d3f84bab831fe4d8aefe983b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 41241 } health_report { overall_health: UNKNOWN } } }
W20260806 02:21:40.180472 22966 tablet.cc:2369] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:21:40.213737 22986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:40.210245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54910 (local address 127.26.189.129:39569)
0806 02:21:40.210418 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:40.210423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:40.210438 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:21:40.210524 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:40.210527 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:40.210586 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:40.210701 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:21:40.210931 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:40.211454 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:40.212281 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:40.212490 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:40.212568 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:40.212831 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:21:40.213276 (+ 445us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:21:40.213370 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:40.213427 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 02:21:40.213477 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 02:21:40.220161 22737 raft_consensus.cc:1261] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c [term 1 FOLLOWER]: Refusing update from remote peer 51f9cfcee4c44b1099a22be3ff5c0c91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:21:40.220185 22907 raft_consensus.cc:1261] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b [term 1 FOLLOWER]: Refusing update from remote peer 51f9cfcee4c44b1099a22be3ff5c0c91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:21:40.220944 23002 consensus_queue.cc:1035] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ca69408494bed9c175d20b9e8de3c" member_type: VOTER last_known_addr { host: "127.26.189.130" port: 45393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:21:40.221192 22998 consensus_queue.cc:1035] T ffb2bcf41e174a5da33cedd1a3029b67 P 51f9cfcee4c44b1099a22be3ff5c0c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c7d196d3f84bab831fe4d8aefe983b" member_type: VOTER last_known_addr { host: "127.26.189.131" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:21:40.230189 23010 mvcc.cc:205] Tried to move back new op lower bound from 7315385959294144512 to 7315385959120187392. Current Snapshot: MvccSnapshot[applied={T|T < 7315385959294144512}]
I20260806 02:21:40.230430 23015 mvcc.cc:205] Tried to move back new op lower bound from 7315385959294144512 to 7315385959120187392. Current Snapshot: MvccSnapshot[applied={T|T < 7315385959294144512}]
W20260806 02:21:40.231824 22796 tablet.cc:2369] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 02:21:40.238538 22362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:21:40.238732 22362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 02:21:40.241442 22362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b7b9c3c312741fab261f9f7c3fba218: Sending DeleteTablet for 3 replicas of tablet ffb2bcf41e174a5da33cedd1a3029b67
I20260806 02:21:40.242471 22518 tablet_service.cc:1514] Processing DeleteTablet for tablet ffb2bcf41e174a5da33cedd1a3029b67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:40 UTC) from {username='slave'} at 127.0.0.1:54896
I20260806 02:21:40.242481 22880 tablet_service.cc:1514] Processing DeleteTablet for tablet ffb2bcf41e174a5da33cedd1a3029b67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:40 UTC) from {username='slave'} at 127.0.0.1:37348
I20260806 02:21:40.243101 22708 tablet_service.cc:1514] Processing DeleteTablet for tablet ffb2bcf41e174a5da33cedd1a3029b67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 02:21:40 UTC) from {username='slave'} at 127.0.0.1:52332
I20260806 02:21:40.243396 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 22438
I20260806 02:21:40.249194 23029 tablet_replica.cc:330] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c: stopping tablet replica
I20260806 02:21:40.249630 23029 raft_consensus.cc:2229] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:21:40.250056 23029 raft_consensus.cc:2258] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:40.252035 23029 ts_tablet_manager.cc:1905] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 02:21:40.254772 23029 ts_tablet_manager.cc:1918] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:21:40.254871 23029 log.cc:1196] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-1/wal/wals/ffb2bcf41e174a5da33cedd1a3029b67
I20260806 02:21:40.255264 23029 ts_tablet_manager.cc:1939] T ffb2bcf41e174a5da33cedd1a3029b67 P ae4ca69408494bed9c175d20b9e8de3c: Deleting consensus metadata
I20260806 02:21:40.256909 22345 catalog_manager.cc:4841] TS ae4ca69408494bed9c175d20b9e8de3c (127.26.189.130:45393): tablet ffb2bcf41e174a5da33cedd1a3029b67 (table test-table [id=05e0054921ef40cbb54faa9337c40fde]) successfully deleted
I20260806 02:21:40.256950 23024 tablet_replica.cc:330] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b: stopping tablet replica
I20260806 02:21:40.257403 23024 raft_consensus.cc:2229] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 02:21:40.257854 23024 raft_consensus.cc:2258] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 02:21:40.259595 23024 ts_tablet_manager.cc:1905] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 02:21:40.263032 22346 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.189.129:39569 (error 108)
I20260806 02:21:40.263463 23024 ts_tablet_manager.cc:1918] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 02:21:40.263586 23024 log.cc:1196] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b: Deleting WAL directory at /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785982634882397-27382-0/minicluster-data/ts-2/wal/wals/ffb2bcf41e174a5da33cedd1a3029b67
I20260806 02:21:40.263936 23024 ts_tablet_manager.cc:1939] T ffb2bcf41e174a5da33cedd1a3029b67 P 10c7d196d3f84bab831fe4d8aefe983b: Deleting consensus metadata
I20260806 02:21:40.264143 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 22619
I20260806 02:21:40.264300 22984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:40.263957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.129:39569 (local address 127.0.0.1:54914)
0806 02:21:40.264101 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 02:21:40.264188 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.129:39569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 02:21:40.266527 22347 catalog_manager.cc:4841] TS 10c7d196d3f84bab831fe4d8aefe983b (127.26.189.131:41241): tablet ffb2bcf41e174a5da33cedd1a3029b67 (table test-table [id=05e0054921ef40cbb54faa9337c40fde]) successfully deleted
W20260806 02:21:40.266719 22346 catalog_manager.cc:4584] TS 51f9cfcee4c44b1099a22be3ff5c0c91 (127.26.189.129:39569): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ffb2bcf41e174a5da33cedd1a3029b67: Network error: Client connection negotiation failed: client connection to 127.26.189.129:39569: connect: Connection refused (error 111)
I20260806 02:21:40.276528 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 22798
I20260806 02:21:40.290469 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 22326
2026-08-06T02:21:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1264 ms)
[----------] 6 tests from EncryptionPolicyTest (11543 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:40 dist-test-slave-gkw7 krb5kdc[23033](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:40 dist-test-slave-gkw7 krb5kdc[23033](info): set up 2 sockets
Aug 06 02:21:40 dist-test-slave-gkw7 krb5kdc[23033](info): commencing operation
krb5kdc: starting...
W20260806 02:21:41.498723 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:41 dist-test-slave-gkw7 krb5kdc[23033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 02:21:41.633813 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39035
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:41.752908 23056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:41.753271 23056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:41.753369 23056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:41.757457 23056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:41.757591 23056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:41.757642 23056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:41.757678 23056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:41.757709 23056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:41.763300 23056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39035
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:41.764446 23056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:41.765560 23056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:41.774293 23062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:41.774277 23065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:41.774255 23056 server_base.cc:1034] running on GCE node
W20260806 02:21:41.774243 23061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:41.775117 23056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:41.776244 23056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:41.777462 23056 hybrid_clock.cc:648] HybridClock initialized: now 1785982901777431 us; error 47 us; skew 500 ppm
Aug 06 02:21:41 dist-test-slave-gkw7 krb5kdc[23033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982901, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:41.780267 23056 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 02:21:41.781270 23056 webserver.cc:460] Webserver started at http://127.0.0.1:35931/ using document root <none> and password file <none>
I20260806 02:21:41.781930 23056 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:41.782032 23056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:41.782292 23056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:41.784446 23056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "6fb6fbc3d2f04e6a8114624e377c3404"
format_stamp: "Formatted at 2026-08-06 02:21:41 on dist-test-slave-gkw7"
server_key: "c51da920bd01671c2ae092dffc5a88cc"
server_key_iv: "56bc38cfb8cdddf4489674292429e092"
server_key_version: "encryptionkey@0"
I20260806 02:21:41.785073 23056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "6fb6fbc3d2f04e6a8114624e377c3404"
format_stamp: "Formatted at 2026-08-06 02:21:41 on dist-test-slave-gkw7"
server_key: "c51da920bd01671c2ae092dffc5a88cc"
server_key_iv: "56bc38cfb8cdddf4489674292429e092"
server_key_version: "encryptionkey@0"
I20260806 02:21:41.789108 23056 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:21:41.791922 23074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:41.793313 23056 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:21:41.793467 23056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "6fb6fbc3d2f04e6a8114624e377c3404"
format_stamp: "Formatted at 2026-08-06 02:21:41 on dist-test-slave-gkw7"
server_key: "c51da920bd01671c2ae092dffc5a88cc"
server_key_iv: "56bc38cfb8cdddf4489674292429e092"
server_key_version: "encryptionkey@0"
I20260806 02:21:41.793635 23056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:41.811252 23056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:41.814527 23056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:41.814752 23056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:41.822466 23056 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39035
I20260806 02:21:41.822492 23148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39035 every 8 connection(s)
I20260806 02:21:41.823484 23056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:41.826437 23149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:41.831820 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 23056
I20260806 02:21:41.831990 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:41.832212 23149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404: Bootstrap starting.
I20260806 02:21:41.832294 27382 external_mini_cluster.cc:1428] Setting key ef37830a972b4d3600cab8f5d670a2e6
I20260806 02:21:41.835072 23149 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:41.835985 23149 log.cc:824] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:41.838413 23149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404: No bootstrap required, opened a new log
Aug 06 02:21:41 dist-test-slave-gkw7 krb5kdc[23033](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 02:21:41.842568 23149 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fb6fbc3d2f04e6a8114624e377c3404" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39035 } }
I20260806 02:21:41.842922 23149 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:41.843015 23149 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fb6fbc3d2f04e6a8114624e377c3404, State: Initialized, Role: FOLLOWER
I20260806 02:21:41.843628 23149 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fb6fbc3d2f04e6a8114624e377c3404" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39035 } }
I20260806 02:21:41.843827 23149 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:41.843899 23149 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:41.844022 23149 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:41.844905 23149 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fb6fbc3d2f04e6a8114624e377c3404" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39035 } }
I20260806 02:21:41.845247 23149 leader_election.cc:302] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fb6fbc3d2f04e6a8114624e377c3404; no voters:
I20260806 02:21:41.845602 23149 leader_election.cc:288] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:41.845691 23156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:41.845882 23156 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [term 1 LEADER]: Becoming Leader. State: Replica: 6fb6fbc3d2f04e6a8114624e377c3404, State: Running, Role: LEADER
I20260806 02:21:41.846182 23156 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fb6fbc3d2f04e6a8114624e377c3404" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39035 } }
I20260806 02:21:41.846935 23149 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:41.848372 23157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fb6fbc3d2f04e6a8114624e377c3404. Latest consensus state: current_term: 1 leader_uuid: "6fb6fbc3d2f04e6a8114624e377c3404" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fb6fbc3d2f04e6a8114624e377c3404" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39035 } } }
I20260806 02:21:41.848507 23157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:41.848853 23158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6fb6fbc3d2f04e6a8114624e377c3404" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fb6fbc3d2f04e6a8114624e377c3404" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39035 } } }
I20260806 02:21:41.848942 23158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:41.849227 23169 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:41.850032 23152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:41.833839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50167 (local address 127.0.0.1:39035)
0806 02:21:41.834300 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:41.834322 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:41.834366 (+ 44us) server_negotiation.cc:407] Connection header received
0806 02:21:41.835298 (+ 932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:41.835327 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:41.835765 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:41.836139 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:41.837087 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:41.838611 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:41.839756 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:41.840477 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:41.840639 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:41.843578 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:41.843585 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:41.843602 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:41.843643 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:41.845735 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:41.846476 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:41.846483 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:41.846489 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:41.846642 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:41.846986 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:41.846990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:41.846991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:41.847552 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:41.847796 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:41.848643 (+ 847us) server_negotiation.cc:299] Negotiation successful
0806 02:21:41.848902 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":129,"threads_started":1}
I20260806 02:21:41.853013 23169 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:41.853430 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:21:41.859088 23169 catalog_manager.cc:1347] Generated new cluster ID: e0bb4d16b8784e8e80586c38b2bd5506
I20260806 02:21:41.859158 23169 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:41.866577 23152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:41.855887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42951 (local address 127.0.0.1:39035)
0806 02:21:41.855995 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:41.855999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:41.857833 (+ 1834us) server_negotiation.cc:407] Connection header received
0806 02:21:41.857999 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:41.858002 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:41.858042 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:41.858130 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:41.858817 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:41.859574 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:41.860765 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:41.861125 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:41.861220 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:41.862995 (+ 1775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:41.862998 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:41.863001 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:41.863025 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:41.864691 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:41.865241 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:41.865245 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:41.865246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:41.865330 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:41.865678 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:41.865681 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:41.865682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:41.865868 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:41.866024 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:41.866322 (+ 298us) server_negotiation.cc:299] Negotiation successful
0806 02:21:41.866415 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 02:21:41.879904 23169 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:41.880870 23169 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:41.886461 23169 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6fb6fbc3d2f04e6a8114624e377c3404: Generated new TSK 0
I20260806 02:21:41.887356 23169 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:41.894810 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 23056
W20260806 02:21:41.907298 23031 connection.cc:535] client connection to 127.0.0.1:39035 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39035): Connection reset by peer (error 104)
2026-08-06T02:21:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1605 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:41 dist-test-slave-gkw7 krb5kdc[23189](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:41 dist-test-slave-gkw7 krb5kdc[23189](info): set up 2 sockets
Aug 06 02:21:41 dist-test-slave-gkw7 krb5kdc[23189](info): commencing operation
krb5kdc: starting...
W20260806 02:21:43.128790 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:43 dist-test-slave-gkw7 krb5kdc[23189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 02:21:43.269200 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41823
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:43.389446 23211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:43.389810 23211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:43.389886 23211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:43.393858 23211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:43.393920 23211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:43.393973 23211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:43.394016 23211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:43.394127 23211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:43.399642 23211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41823
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:43.400769 23211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:43.401912 23211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:43.410840 23218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:43.410915 23211 server_base.cc:1034] running on GCE node
W20260806 02:21:43.410840 23217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:43.410873 23220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:43.411800 23211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:43.412931 23211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:43.414129 23211 hybrid_clock.cc:648] HybridClock initialized: now 1785982903414091 us; error 45 us; skew 500 ppm
Aug 06 02:21:43 dist-test-slave-gkw7 krb5kdc[23189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982903, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:43.422219 23211 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 02:21:43.423305 23211 webserver.cc:460] Webserver started at http://127.0.0.1:34413/ using document root <none> and password file <none>
I20260806 02:21:43.423938 23211 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:43.424008 23211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:43.424299 23211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:43.426692 23211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "483d3b100b66412e966bcb623be43309"
format_stamp: "Formatted at 2026-08-06 02:21:43 on dist-test-slave-gkw7"
server_key: "203993e32a0d11417b0e7fb0b5ab7f6b"
server_key_iv: "a4299dc5ede7a96454cceb51a2dbbdbe"
server_key_version: "encryptionkey@0"
I20260806 02:21:43.427326 23211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "483d3b100b66412e966bcb623be43309"
format_stamp: "Formatted at 2026-08-06 02:21:43 on dist-test-slave-gkw7"
server_key: "203993e32a0d11417b0e7fb0b5ab7f6b"
server_key_iv: "a4299dc5ede7a96454cceb51a2dbbdbe"
server_key_version: "encryptionkey@0"
I20260806 02:21:43.431579 23211 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 02:21:43.434173 23231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:43.435479 23211 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:21:43.435627 23211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "483d3b100b66412e966bcb623be43309"
format_stamp: "Formatted at 2026-08-06 02:21:43 on dist-test-slave-gkw7"
server_key: "203993e32a0d11417b0e7fb0b5ab7f6b"
server_key_iv: "a4299dc5ede7a96454cceb51a2dbbdbe"
server_key_version: "encryptionkey@0"
I20260806 02:21:43.435743 23211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:43.461867 23211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:43.465401 23211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:43.465653 23211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:43.473086 23211 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41823
I20260806 02:21:43.473104 23298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41823 every 8 connection(s)
I20260806 02:21:43.474082 23211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:43.476791 23301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:43.477238 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 23211
I20260806 02:21:43.477494 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:43.477833 27382 external_mini_cluster.cc:1428] Setting key 0a13b9c900273b6b5124559a9f815541
I20260806 02:21:43.483402 23301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309: Bootstrap starting.
I20260806 02:21:43.486425 23301 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:43.487422 23301 log.cc:824] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:43.487655 23304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:43.479304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43677 (local address 127.0.0.1:41823)
0806 02:21:43.479800 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:43.479815 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:43.479865 (+ 50us) server_negotiation.cc:407] Connection header received
0806 02:21:43.480511 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:43.480528 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:43.480880 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:43.481236 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:43.481694 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:43.482708 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:43.483647 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:43.484390 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:43.484579 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:43.485459 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:43.485465 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:43.485482 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:43.486066 (+ 584us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:43.486144 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:43.486179 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:43.486348 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:43.486461 (+ 113us) server_negotiation.cc:299] Negotiation successful
0806 02:21:43.486611 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":146,"threads_started":1}
I20260806 02:21:43.489931 23301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309: No bootstrap required, opened a new log
I20260806 02:21:43.490890 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:21:43.495306 23301 raft_consensus.cc:348] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483d3b100b66412e966bcb623be43309" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41823 } }
I20260806 02:21:43.495581 23301 raft_consensus.cc:374] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:43.495621 23301 raft_consensus.cc:729] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483d3b100b66412e966bcb623be43309, State: Initialized, Role: FOLLOWER
I20260806 02:21:43.496147 23301 consensus_queue.cc:260] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483d3b100b66412e966bcb623be43309" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41823 } }
I20260806 02:21:43.496281 23301 raft_consensus.cc:388] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:43.496376 23301 raft_consensus.cc:482] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:43.496483 23301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:43.497764 23301 raft_consensus.cc:504] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483d3b100b66412e966bcb623be43309" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41823 } }
I20260806 02:21:43.498188 23301 leader_election.cc:302] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 483d3b100b66412e966bcb623be43309; no voters:
I20260806 02:21:43.498647 23301 leader_election.cc:288] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:43.498790 23316 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:43.498919 23304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:43.493419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57985 (local address 127.0.0.1:41823)
0806 02:21:43.493602 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:43.493609 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:43.493833 (+ 224us) server_negotiation.cc:407] Connection header received
0806 02:21:43.493920 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:43.493923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:43.493970 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:43.494064 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:43.494360 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:43.495218 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:43.496545 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:43.496964 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:43.497084 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:43.498153 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:43.498157 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:43.498161 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:43.498174 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:43.498207 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:43.498224 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:43.498339 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:43.498593 (+ 254us) server_negotiation.cc:299] Negotiation successful
0806 02:21:43.498633 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 02:21:43.499106 23316 raft_consensus.cc:686] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [term 1 LEADER]: Becoming Leader. State: Replica: 483d3b100b66412e966bcb623be43309, State: Running, Role: LEADER
I20260806 02:21:43.499454 23316 consensus_queue.cc:237] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483d3b100b66412e966bcb623be43309" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41823 } }
I20260806 02:21:43.500238 23301 sys_catalog.cc:564] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:43.500717 23316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "483d3b100b66412e966bcb623be43309" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483d3b100b66412e966bcb623be43309" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41823 } } }
I20260806 02:21:43.500849 23316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:43.501134 23316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 483d3b100b66412e966bcb623be43309. Latest consensus state: current_term: 1 leader_uuid: "483d3b100b66412e966bcb623be43309" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483d3b100b66412e966bcb623be43309" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41823 } } }
I20260806 02:21:43.501291 23322 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:43.501302 23316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:43.504918 23322 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:43.511315 23322 catalog_manager.cc:1347] Generated new cluster ID: 0f7ce5ec20344e4b846e8526737544c2
I20260806 02:21:43.511392 23322 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:43.539616 23322 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:43.541021 23322 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:43.547282 23322 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 483d3b100b66412e966bcb623be43309: Generated new TSK 0
I20260806 02:21:43.548139 23322 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:43.555531 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 23211
W20260806 02:21:43.572479 23187 connection.cc:535] client connection to 127.0.0.1:41823 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41823): Connection reset by peer (error 104)
2026-08-06T02:21:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1665 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:43 dist-test-slave-gkw7 krb5kdc[23340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:43 dist-test-slave-gkw7 krb5kdc[23340](info): set up 2 sockets
Aug 06 02:21:43 dist-test-slave-gkw7 krb5kdc[23340](info): commencing operation
krb5kdc: starting...
W20260806 02:21:44.848871 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:44 dist-test-slave-gkw7 krb5kdc[23340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 02:21:44.978961 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42061
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:45.093299 23359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:45.093638 23359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:45.093727 23359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:45.097682 23359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:45.097767 23359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:45.097805 23359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:45.097844 23359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:45.097877 23359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:45.103114 23359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42061
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:45.104243 23359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:45.105314 23359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:45.114171 23371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:45.114169 23374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:45.114164 23368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:45.114245 23359 server_base.cc:1034] running on GCE node
I20260806 02:21:45.115008 23359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:45.116103 23359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:45.117280 23359 hybrid_clock.cc:648] HybridClock initialized: now 1785982905117265 us; error 31 us; skew 500 ppm
Aug 06 02:21:45 dist-test-slave-gkw7 krb5kdc[23340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982905, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:45.125012 23359 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 02:21:45.126068 23359 webserver.cc:460] Webserver started at http://127.0.0.1:32991/ using document root <none> and password file <none>
I20260806 02:21:45.126657 23359 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:45.126721 23359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:45.127017 23359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:45.129093 23359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "c1f52173aa054f159c176202c825160f"
format_stamp: "Formatted at 2026-08-06 02:21:45 on dist-test-slave-gkw7"
server_key: "30a08b6a96d952a593e8e21ba09bc871"
server_key_iv: "a2ba721b58449d9f8d43cf947f4d76dd"
server_key_version: "encryptionkey@0"
I20260806 02:21:45.129769 23359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "c1f52173aa054f159c176202c825160f"
format_stamp: "Formatted at 2026-08-06 02:21:45 on dist-test-slave-gkw7"
server_key: "30a08b6a96d952a593e8e21ba09bc871"
server_key_iv: "a2ba721b58449d9f8d43cf947f4d76dd"
server_key_version: "encryptionkey@0"
I20260806 02:21:45.133469 23359 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:21:45.135887 23385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:45.137149 23359 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 02:21:45.137295 23359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "c1f52173aa054f159c176202c825160f"
format_stamp: "Formatted at 2026-08-06 02:21:45 on dist-test-slave-gkw7"
server_key: "30a08b6a96d952a593e8e21ba09bc871"
server_key_iv: "a2ba721b58449d9f8d43cf947f4d76dd"
server_key_version: "encryptionkey@0"
I20260806 02:21:45.137384 23359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:45.142030 23359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:45.144918 23359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:45.145112 23359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:45.152515 23359 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42061
I20260806 02:21:45.152554 23457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42061 every 8 connection(s)
I20260806 02:21:45.153424 23359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:45.156018 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 23359
I20260806 02:21:45.156183 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:45.156446 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:45.156538 27382 external_mini_cluster.cc:1428] Setting key 1a8aa140bcf3788fb9c2c8318ab1e25b
I20260806 02:21:45.162211 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:45.158015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60883 (local address 127.0.0.1:42061)
0806 02:21:45.158445 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:45.158468 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:45.158502 (+ 34us) server_negotiation.cc:407] Connection header received
0806 02:21:45.159268 (+ 766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:45.159287 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:45.159558 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:45.159909 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:45.160696 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:45.160701 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:45.160713 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:45.160723 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:45.160783 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:45.160802 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:45.160957 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:45.161028 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 02:21:45.161189 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":128,"threads_started":1}
I20260806 02:21:45.163578 23458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f: Bootstrap starting.
I20260806 02:21:45.165149 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:21:45.166049 23458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:45.166852 23458 log.cc:824] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:45.169093 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:45.167428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48223 (local address 127.0.0.1:42061)
0806 02:21:45.167555 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:45.167562 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:45.167733 (+ 171us) server_negotiation.cc:407] Connection header received
0806 02:21:45.167859 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:45.167861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:45.167890 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:45.167958 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:45.168676 (+ 718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:45.168679 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:45.168681 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:45.168691 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:45.168716 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:45.168726 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:45.168795 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:45.168912 (+ 117us) server_negotiation.cc:299] Negotiation successful
0806 02:21:45.168943 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 02:21:45.169365 23458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f: No bootstrap required, opened a new log
I20260806 02:21:45.173166 23458 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f52173aa054f159c176202c825160f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42061 } }
I20260806 02:21:45.173388 23458 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:45.173470 23458 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f52173aa054f159c176202c825160f, State: Initialized, Role: FOLLOWER
I20260806 02:21:45.173904 23458 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f52173aa054f159c176202c825160f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42061 } }
I20260806 02:21:45.174048 23458 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:45.174113 23458 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:45.174211 23458 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:45.175143 23458 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f52173aa054f159c176202c825160f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42061 } }
I20260806 02:21:45.175480 23458 leader_election.cc:302] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1f52173aa054f159c176202c825160f; no voters:
I20260806 02:21:45.175812 23458 leader_election.cc:288] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:45.175976 23473 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:45.176221 23473 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [term 1 LEADER]: Becoming Leader. State: Replica: c1f52173aa054f159c176202c825160f, State: Running, Role: LEADER
I20260806 02:21:45.176573 23473 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f52173aa054f159c176202c825160f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42061 } }
I20260806 02:21:45.177130 23458 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:45.178344 23475 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1f52173aa054f159c176202c825160f. Latest consensus state: current_term: 1 leader_uuid: "c1f52173aa054f159c176202c825160f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f52173aa054f159c176202c825160f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42061 } } }
I20260806 02:21:45.178539 23475 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:45.178884 23474 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1f52173aa054f159c176202c825160f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f52173aa054f159c176202c825160f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42061 } } }
I20260806 02:21:45.179054 23474 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:45.179433 23488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:45.182797 23488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:45.188719 23488 catalog_manager.cc:1347] Generated new cluster ID: 75db2bc1558f48a99d0e139f2f693ff3
I20260806 02:21:45.188784 23488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:45.203493 23488 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:45.203845 23488 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:45.209267 23488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1f52173aa054f159c176202c825160f: Generated new TSK 0
I20260806 02:21:45.210088 23488 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:45.218207 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 23359
2026-08-06T02:21:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1656 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:45 dist-test-slave-gkw7 krb5kdc[23511](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:45 dist-test-slave-gkw7 krb5kdc[23511](info): set up 2 sockets
Aug 06 02:21:45 dist-test-slave-gkw7 krb5kdc[23511](info): commencing operation
krb5kdc: starting...
W20260806 02:21:46.425254 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:46 dist-test-slave-gkw7 krb5kdc[23511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 02:21:46.553009 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45839
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45839
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:46.667752 23524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:46.668044 23524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:46.668141 23524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:46.672073 23524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:46.672159 23524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:46.672197 23524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:46.672250 23524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:46.672286 23524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:46.677363 23524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45839
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:46.678424 23524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:46.679440 23524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:46.687959 23534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:46.688140 23531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:46.688210 23532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:46.688161 23524 server_base.cc:1034] running on GCE node
I20260806 02:21:46.688854 23524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:46.690012 23524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:46.691210 23524 hybrid_clock.cc:648] HybridClock initialized: now 1785982906691176 us; error 47 us; skew 500 ppm
Aug 06 02:21:46 dist-test-slave-gkw7 krb5kdc[23511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982906, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:46.693884 23524 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 02:21:46.694690 23524 webserver.cc:460] Webserver started at http://127.0.0.1:39441/ using document root <none> and password file <none>
I20260806 02:21:46.695255 23524 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:46.695349 23524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:46.695582 23524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:46.697626 23524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "b92e0febcc6643f79bbcebb52d8ca798"
format_stamp: "Formatted at 2026-08-06 02:21:46 on dist-test-slave-gkw7"
server_key: "8cebafc65a45b0860fd65a87df18c1d9"
server_key_iv: "b775ae3730d5e8d9d43602693dfc6798"
server_key_version: "encryptionkey@0"
I20260806 02:21:46.698206 23524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "b92e0febcc6643f79bbcebb52d8ca798"
format_stamp: "Formatted at 2026-08-06 02:21:46 on dist-test-slave-gkw7"
server_key: "8cebafc65a45b0860fd65a87df18c1d9"
server_key_iv: "b775ae3730d5e8d9d43602693dfc6798"
server_key_version: "encryptionkey@0"
I20260806 02:21:46.701956 23524 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 02:21:46.704452 23544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:46.705703 23524 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:21:46.705839 23524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "b92e0febcc6643f79bbcebb52d8ca798"
format_stamp: "Formatted at 2026-08-06 02:21:46 on dist-test-slave-gkw7"
server_key: "8cebafc65a45b0860fd65a87df18c1d9"
server_key_iv: "b775ae3730d5e8d9d43602693dfc6798"
server_key_version: "encryptionkey@0"
I20260806 02:21:46.705951 23524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:46.720819 23524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:46.723518 23524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:46.723721 23524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:46.730938 23524 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45839
I20260806 02:21:46.730953 23617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45839 every 8 connection(s)
I20260806 02:21:46.731859 23524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:46.734508 23619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:46.739861 23619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798: Bootstrap starting.
I20260806 02:21:46.740057 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 23524
I20260806 02:21:46.740211 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:46.740499 27382 external_mini_cluster.cc:1428] Setting key a6c185ec706f9aac25fc70adf532ebf3
I20260806 02:21:46.742529 23619 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:46.743261 23619 log.cc:824] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:46.745134 23619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798: No bootstrap required, opened a new log
I20260806 02:21:46.748623 23619 raft_consensus.cc:348] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b92e0febcc6643f79bbcebb52d8ca798" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45839 } }
I20260806 02:21:46.748914 23619 raft_consensus.cc:374] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:46.748971 23619 raft_consensus.cc:729] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b92e0febcc6643f79bbcebb52d8ca798, State: Initialized, Role: FOLLOWER
Aug 06 02:21:46 dist-test-slave-gkw7 krb5kdc[23511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 02:21:46.749476 23619 consensus_queue.cc:260] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b92e0febcc6643f79bbcebb52d8ca798" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45839 } }
I20260806 02:21:46.749673 23619 raft_consensus.cc:388] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:46.749750 23619 raft_consensus.cc:482] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:46.749868 23619 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:46.750849 23619 raft_consensus.cc:504] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b92e0febcc6643f79bbcebb52d8ca798" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45839 } }
I20260806 02:21:46.751232 23619 leader_election.cc:302] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b92e0febcc6643f79bbcebb52d8ca798; no voters:
I20260806 02:21:46.751621 23619 leader_election.cc:288] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:46.751680 23624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:46.751905 23624 raft_consensus.cc:686] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [term 1 LEADER]: Becoming Leader. State: Replica: b92e0febcc6643f79bbcebb52d8ca798, State: Running, Role: LEADER
I20260806 02:21:46.752239 23624 consensus_queue.cc:237] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b92e0febcc6643f79bbcebb52d8ca798" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45839 } }
I20260806 02:21:46.752871 23619 sys_catalog.cc:564] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:46.753993 23626 sys_catalog.cc:455] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b92e0febcc6643f79bbcebb52d8ca798" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b92e0febcc6643f79bbcebb52d8ca798" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45839 } } }
I20260806 02:21:46.754139 23626 sys_catalog.cc:458] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:46.754575 23636 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:46.754539 23627 sys_catalog.cc:455] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b92e0febcc6643f79bbcebb52d8ca798. Latest consensus state: current_term: 1 leader_uuid: "b92e0febcc6643f79bbcebb52d8ca798" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b92e0febcc6643f79bbcebb52d8ca798" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45839 } } }
I20260806 02:21:46.754678 23627 sys_catalog.cc:458] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:46.756330 23622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:46.741889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52411 (local address 127.0.0.1:45839)
0806 02:21:46.742321 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:46.742337 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:46.742375 (+ 38us) server_negotiation.cc:407] Connection header received
0806 02:21:46.743049 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:46.743067 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:46.743417 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:46.743778 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:46.744590 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:46.745679 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:46.746550 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:46.747028 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:46.747206 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:46.750233 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:46.750239 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:46.750254 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:46.750283 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:46.752425 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:46.752898 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:46.752903 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:46.752907 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:46.753072 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:46.753382 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:46.753387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:46.753389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:46.753993 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:46.754214 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:46.754972 (+ 758us) server_negotiation.cc:299] Negotiation successful
0806 02:21:46.755322 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":130,"threads_started":1}
I20260806 02:21:46.757817 23636 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:46.759699 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:21:46.765748 23636 catalog_manager.cc:1347] Generated new cluster ID: 9e1013047b4f4fc4972288474d89f8e2
I20260806 02:21:46.765811 23636 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:46.770810 23622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:46.761840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41925 (local address 127.0.0.1:45839)
0806 02:21:46.761943 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:46.761947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:46.762202 (+ 255us) server_negotiation.cc:407] Connection header received
0806 02:21:46.762312 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:46.762317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:46.762383 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:46.762488 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:46.763283 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:46.764070 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:46.764935 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:46.765235 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:46.765365 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:46.767163 (+ 1798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:46.767167 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:46.767170 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:46.767195 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:46.768971 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:46.769423 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:46.769426 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:46.769428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:46.769520 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:46.769878 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:46.769881 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:46.769883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:46.770085 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:46.770195 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:46.770536 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 02:21:46.770649 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 02:21:46.793475 23636 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:46.794749 23636 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:46.798955 23636 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b92e0febcc6643f79bbcebb52d8ca798: Generated new TSK 0
I20260806 02:21:46.799662 23636 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:46.809146 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 23524
2026-08-06T02:21:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1594 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:46 dist-test-slave-gkw7 krb5kdc[23661](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:46 dist-test-slave-gkw7 krb5kdc[23661](info): set up 2 sockets
Aug 06 02:21:46 dist-test-slave-gkw7 krb5kdc[23661](info): commencing operation
krb5kdc: starting...
W20260806 02:21:48.014360 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:48 dist-test-slave-gkw7 krb5kdc[23661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 02:21:48.148195 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36341
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36341
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:48.264879 23678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:48.265133 23678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:48.265208 23678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:48.269193 23678 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:48.269251 23678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:48.269271 23678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:48.269313 23678 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:48.269348 23678 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:48.274784 23678 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:48.275822 23678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:48.277217 23678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:48.285969 23689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:48.285939 23685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:48.286067 23678 server_base.cc:1034] running on GCE node
W20260806 02:21:48.286273 23684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:48.286890 23678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:48.287933 23678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:48.289124 23678 hybrid_clock.cc:648] HybridClock initialized: now 1785982908289083 us; error 33 us; skew 500 ppm
Aug 06 02:21:48 dist-test-slave-gkw7 krb5kdc[23661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982908, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:48.292032 23678 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 02:21:48.292923 23678 webserver.cc:460] Webserver started at http://127.0.0.1:35059/ using document root <none> and password file <none>
I20260806 02:21:48.293480 23678 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:48.293617 23678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:48.293857 23678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:48.295853 23678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "063f6dd151ad432db526253001cef0e5"
format_stamp: "Formatted at 2026-08-06 02:21:48 on dist-test-slave-gkw7"
server_key: "e5b855c424dca7dc891b6fd2355bfca0"
server_key_iv: "8a6faef34831039e80e9a2c6521ba110"
server_key_version: "encryptionkey@0"
I20260806 02:21:48.296434 23678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "063f6dd151ad432db526253001cef0e5"
format_stamp: "Formatted at 2026-08-06 02:21:48 on dist-test-slave-gkw7"
server_key: "e5b855c424dca7dc891b6fd2355bfca0"
server_key_iv: "8a6faef34831039e80e9a2c6521ba110"
server_key_version: "encryptionkey@0"
I20260806 02:21:48.300230 23678 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 02:21:48.302874 23698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:48.304098 23678 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 02:21:48.304267 23678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "063f6dd151ad432db526253001cef0e5"
format_stamp: "Formatted at 2026-08-06 02:21:48 on dist-test-slave-gkw7"
server_key: "e5b855c424dca7dc891b6fd2355bfca0"
server_key_iv: "8a6faef34831039e80e9a2c6521ba110"
server_key_version: "encryptionkey@0"
I20260806 02:21:48.304417 23678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:48.329465 23678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:48.332687 23678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:48.332846 23678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:48.340224 23678 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36341
I20260806 02:21:48.340248 23766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36341 every 8 connection(s)
I20260806 02:21:48.341189 23678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:48.343955 23768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:48.345170 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 23678
I20260806 02:21:48.345347 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:48.345692 27382 external_mini_cluster.cc:1428] Setting key cf927fee0ef68df6a33145f81f71d68a
I20260806 02:21:48.350055 23768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5: Bootstrap starting.
I20260806 02:21:48.352221 23768 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:48.353091 23768 log.cc:824] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:48.354825 23774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:48.347162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36583 (local address 127.0.0.1:36341)
0806 02:21:48.347616 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:48.347633 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:48.347668 (+ 35us) server_negotiation.cc:407] Connection header received
0806 02:21:48.348294 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:48.348310 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:48.348635 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:48.348966 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:48.349415 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:48.350474 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:48.351390 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:48.351879 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:48.352070 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:48.352952 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:48.352957 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:48.352970 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:48.353428 (+ 458us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:48.353484 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:48.353507 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:48.353689 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:48.353847 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 02:21:48.354054 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":138,"threads_started":1}
I20260806 02:21:48.355221 23768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5: No bootstrap required, opened a new log
I20260806 02:21:48.357605 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:21:48.359148 23768 raft_consensus.cc:348] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "063f6dd151ad432db526253001cef0e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36341 } }
I20260806 02:21:48.359395 23768 raft_consensus.cc:374] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:48.359483 23768 raft_consensus.cc:729] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 063f6dd151ad432db526253001cef0e5, State: Initialized, Role: FOLLOWER
I20260806 02:21:48.360064 23768 consensus_queue.cc:260] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "063f6dd151ad432db526253001cef0e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36341 } }
I20260806 02:21:48.360271 23768 raft_consensus.cc:388] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:48.360349 23768 raft_consensus.cc:482] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:48.360461 23768 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:48.361439 23768 raft_consensus.cc:504] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "063f6dd151ad432db526253001cef0e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36341 } }
I20260806 02:21:48.361830 23768 leader_election.cc:302] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 063f6dd151ad432db526253001cef0e5; no voters:
I20260806 02:21:48.362182 23768 leader_election.cc:288] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:48.362301 23784 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:48.362558 23784 raft_consensus.cc:686] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [term 1 LEADER]: Becoming Leader. State: Replica: 063f6dd151ad432db526253001cef0e5, State: Running, Role: LEADER
I20260806 02:21:48.362910 23784 consensus_queue.cc:237] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "063f6dd151ad432db526253001cef0e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36341 } }
I20260806 02:21:48.363510 23768 sys_catalog.cc:564] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:48.364537 23774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:48.359627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59985 (local address 127.0.0.1:36341)
0806 02:21:48.359759 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:48.359763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:48.359987 (+ 224us) server_negotiation.cc:407] Connection header received
0806 02:21:48.360091 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:48.360093 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:48.360136 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:48.360201 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:48.360513 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:48.361168 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:48.362375 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:48.362727 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:48.362838 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:48.363804 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:48.363808 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:48.363810 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:48.363823 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:48.363851 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:48.363864 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:48.363953 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:48.364287 (+ 334us) server_negotiation.cc:299] Negotiation successful
0806 02:21:48.364353 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":50}
I20260806 02:21:48.364856 23786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "063f6dd151ad432db526253001cef0e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "063f6dd151ad432db526253001cef0e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36341 } } }
I20260806 02:21:48.364948 23786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:48.364614 23787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 063f6dd151ad432db526253001cef0e5. Latest consensus state: current_term: 1 leader_uuid: "063f6dd151ad432db526253001cef0e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "063f6dd151ad432db526253001cef0e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36341 } } }
I20260806 02:21:48.365272 23787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5 [sys.catalog]: This master's current role is: LEADER
W20260806 02:21:48.368404 23808 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:21:48.368467 23808 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:21:48.368553 23800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:48.369207 23800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:48.374614 23800 catalog_manager.cc:1347] Generated new cluster ID: 464f64fd2950488fbef2aba7004728bd
I20260806 02:21:48.374675 23800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:48.382336 23800 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:48.383455 23800 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:48.389628 23800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 063f6dd151ad432db526253001cef0e5: Generated new TSK 0
I20260806 02:21:48.390338 23800 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:48.398185 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 23678
2026-08-06T02:21:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1586 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:48 dist-test-slave-gkw7 krb5kdc[23815](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:48 dist-test-slave-gkw7 krb5kdc[23815](info): set up 2 sockets
Aug 06 02:21:48 dist-test-slave-gkw7 krb5kdc[23815](info): commencing operation
krb5kdc: starting...
W20260806 02:21:49.693025 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:49 dist-test-slave-gkw7 krb5kdc[23815](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 02:21:49.822956 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43925
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:49.934633 23830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:49.934952 23830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:49.935035 23830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:49.939057 23830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:49.939141 23830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:49.939178 23830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:49.939237 23830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:49.939266 23830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:49.944445 23830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:49.945484 23830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:49.946563 23830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:49.955308 23839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:49.955332 23838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:49.955295 23842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:49.955529 23830 server_base.cc:1034] running on GCE node
I20260806 02:21:49.956248 23830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:49.957369 23830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:49.958582 23830 hybrid_clock.cc:648] HybridClock initialized: now 1785982909958530 us; error 47 us; skew 500 ppm
Aug 06 02:21:49 dist-test-slave-gkw7 krb5kdc[23815](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982909, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:49.961481 23830 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 02:21:49.962401 23830 webserver.cc:460] Webserver started at http://127.0.0.1:40289/ using document root <none> and password file <none>
I20260806 02:21:49.962920 23830 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:49.962978 23830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:49.963150 23830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:49.965158 23830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "491c83a657f74c2d9404a695c4bfdf84"
format_stamp: "Formatted at 2026-08-06 02:21:49 on dist-test-slave-gkw7"
server_key: "2c6d2dbc9405c50e0973872c4b07cf5f"
server_key_iv: "ee798522f9086e4240a57fadd21258b8"
server_key_version: "encryptionkey@0"
I20260806 02:21:49.965749 23830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "491c83a657f74c2d9404a695c4bfdf84"
format_stamp: "Formatted at 2026-08-06 02:21:49 on dist-test-slave-gkw7"
server_key: "2c6d2dbc9405c50e0973872c4b07cf5f"
server_key_iv: "ee798522f9086e4240a57fadd21258b8"
server_key_version: "encryptionkey@0"
I20260806 02:21:49.969520 23830 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 02:21:49.972018 23855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:49.973318 23830 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:49.973469 23830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "491c83a657f74c2d9404a695c4bfdf84"
format_stamp: "Formatted at 2026-08-06 02:21:49 on dist-test-slave-gkw7"
server_key: "2c6d2dbc9405c50e0973872c4b07cf5f"
server_key_iv: "ee798522f9086e4240a57fadd21258b8"
server_key_version: "encryptionkey@0"
I20260806 02:21:49.973640 23830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:49.978307 23830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:49.981670 23830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:49.981834 23830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:49.989260 23830 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43925
I20260806 02:21:49.989289 23931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43925 every 8 connection(s)
I20260806 02:21:49.990263 23830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:49.993119 23932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:49.998939 23932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84: Bootstrap starting.
I20260806 02:21:49.999872 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 23830
I20260806 02:21:50.000074 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:50.000385 27382 external_mini_cluster.cc:1428] Setting key 06470796be2fef242359ad06612de575
I20260806 02:21:50.001814 23932 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:50.002607 23932 log.cc:824] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:50.004702 23932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84: No bootstrap required, opened a new log
I20260806 02:21:50.006114 23935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:50.001705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41361 (local address 127.0.0.1:43925)
0806 02:21:50.002217 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:50.002234 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:50.002272 (+ 38us) server_negotiation.cc:407] Connection header received
0806 02:21:50.003062 (+ 790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:50.003084 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:50.003386 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:50.003777 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:50.004645 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:50.004651 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:50.004664 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:50.004676 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:50.004734 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:50.004754 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:50.004894 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:50.005090 (+ 196us) server_negotiation.cc:299] Negotiation successful
0806 02:21:50.005279 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":135,"threads_started":1}
I20260806 02:21:50.008957 23932 raft_consensus.cc:348] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "491c83a657f74c2d9404a695c4bfdf84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43925 } }
I20260806 02:21:50.009263 23932 raft_consensus.cc:374] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:50.009335 23932 raft_consensus.cc:729] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491c83a657f74c2d9404a695c4bfdf84, State: Initialized, Role: FOLLOWER
I20260806 02:21:50.009434 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:21:50.009840 23932 consensus_queue.cc:260] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "491c83a657f74c2d9404a695c4bfdf84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43925 } }
I20260806 02:21:50.009963 23932 raft_consensus.cc:388] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:50.010049 23932 raft_consensus.cc:482] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:50.010149 23932 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:50.011142 23932 raft_consensus.cc:504] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "491c83a657f74c2d9404a695c4bfdf84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43925 } }
I20260806 02:21:50.011498 23932 leader_election.cc:302] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 491c83a657f74c2d9404a695c4bfdf84; no voters:
I20260806 02:21:50.011852 23932 leader_election.cc:288] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:50.011960 23945 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:50.012269 23945 raft_consensus.cc:686] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [term 1 LEADER]: Becoming Leader. State: Replica: 491c83a657f74c2d9404a695c4bfdf84, State: Running, Role: LEADER
I20260806 02:21:50.012773 23945 consensus_queue.cc:237] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "491c83a657f74c2d9404a695c4bfdf84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43925 } }
I20260806 02:21:50.013316 23932 sys_catalog.cc:564] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:50.014354 23935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:50.012023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35355 (local address 127.0.0.1:43925)
0806 02:21:50.012146 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:50.012153 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:50.012540 (+ 387us) server_negotiation.cc:407] Connection header received
0806 02:21:50.012746 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:50.012749 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:50.012789 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:50.012876 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:50.013840 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:50.013844 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:50.013846 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:50.013858 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:50.013888 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:50.013902 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:50.013990 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:50.014137 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 02:21:50.014186 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 02:21:50.014886 23950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 491c83a657f74c2d9404a695c4bfdf84. Latest consensus state: current_term: 1 leader_uuid: "491c83a657f74c2d9404a695c4bfdf84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "491c83a657f74c2d9404a695c4bfdf84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43925 } } }
I20260806 02:21:50.015033 23950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:50.015254 23948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "491c83a657f74c2d9404a695c4bfdf84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "491c83a657f74c2d9404a695c4bfdf84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43925 } } }
I20260806 02:21:50.015437 23948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84 [sys.catalog]: This master's current role is: LEADER
W20260806 02:21:50.018196 23966 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:21:50.018276 23966 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:21:50.018352 23965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:50.019309 23965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:50.025092 23965 catalog_manager.cc:1347] Generated new cluster ID: 5dd008f812994e31a849d81999b23f1a
I20260806 02:21:50.025190 23965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:50.045567 23965 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:50.045956 23965 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:50.059017 23965 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 491c83a657f74c2d9404a695c4bfdf84: Generated new TSK 0
I20260806 02:21:50.059971 23965 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:50.076334 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 23830
2026-08-06T02:21:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1677 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:50 dist-test-slave-gkw7 krb5kdc[23973](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:50 dist-test-slave-gkw7 krb5kdc[23973](info): set up 2 sockets
Aug 06 02:21:50 dist-test-slave-gkw7 krb5kdc[23973](info): commencing operation
krb5kdc: starting...
W20260806 02:21:51.339636 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:51 dist-test-slave-gkw7 krb5kdc[23973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 02:21:51.470870 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44161
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:51.589942 23994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:51.590265 23994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:51.590358 23994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:51.594355 23994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:51.594452 23994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:51.594489 23994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:51.594527 23994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:51.594563 23994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:51.599802 23994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44161
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:51.600947 23994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:51.602075 23994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:51.611181 24006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:51.611151 24004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:51.611279 23994 server_base.cc:1034] running on GCE node
W20260806 02:21:51.611171 24003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:51.612094 23994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:51.613190 23994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:51.614367 23994 hybrid_clock.cc:648] HybridClock initialized: now 1785982911614342 us; error 37 us; skew 500 ppm
Aug 06 02:21:51 dist-test-slave-gkw7 krb5kdc[23973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982911, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:51.617329 23994 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 02:21:51.618315 23994 webserver.cc:460] Webserver started at http://127.0.0.1:40943/ using document root <none> and password file <none>
I20260806 02:21:51.618897 23994 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:51.618988 23994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:51.619235 23994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:51.621344 23994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "48baacd3c93f4c1cac32b7c3c5a11b39"
format_stamp: "Formatted at 2026-08-06 02:21:51 on dist-test-slave-gkw7"
server_key: "e7f5f9e67ad3f16cb76856d0135d350f"
server_key_iv: "0d16828d20b6e35e0b846fd7ec4aca38"
server_key_version: "encryptionkey@0"
I20260806 02:21:51.621974 23994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "48baacd3c93f4c1cac32b7c3c5a11b39"
format_stamp: "Formatted at 2026-08-06 02:21:51 on dist-test-slave-gkw7"
server_key: "e7f5f9e67ad3f16cb76856d0135d350f"
server_key_iv: "0d16828d20b6e35e0b846fd7ec4aca38"
server_key_version: "encryptionkey@0"
I20260806 02:21:51.625753 23994 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:21:51.628232 24019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:51.629503 23994 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:51.629717 23994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "48baacd3c93f4c1cac32b7c3c5a11b39"
format_stamp: "Formatted at 2026-08-06 02:21:51 on dist-test-slave-gkw7"
server_key: "e7f5f9e67ad3f16cb76856d0135d350f"
server_key_iv: "0d16828d20b6e35e0b846fd7ec4aca38"
server_key_version: "encryptionkey@0"
I20260806 02:21:51.629832 23994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:51.656312 23994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:51.659916 23994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:51.660136 23994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:51.667791 23994 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44161
I20260806 02:21:51.667821 24091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44161 every 8 connection(s)
I20260806 02:21:51.668761 23994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:51.671540 24093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:51.677184 24093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39: Bootstrap starting.
I20260806 02:21:51.678809 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 23994
I20260806 02:21:51.678962 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:51.679262 27382 external_mini_cluster.cc:1428] Setting key cddfd3cc50f9db469d427cfa39771f25
I20260806 02:21:51.680069 24093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:51.680995 24093 log.cc:824] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:51.683319 24093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39: No bootstrap required, opened a new log
I20260806 02:21:51.687736 24093 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48baacd3c93f4c1cac32b7c3c5a11b39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44161 } }
I20260806 02:21:51.688035 24093 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:51.688126 24093 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48baacd3c93f4c1cac32b7c3c5a11b39, State: Initialized, Role: FOLLOWER
Aug 06 02:21:51 dist-test-slave-gkw7 krb5kdc[23973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 02:21:51.688592 24093 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48baacd3c93f4c1cac32b7c3c5a11b39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44161 } }
I20260806 02:21:51.688760 24093 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:51.688838 24093 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:51.688963 24093 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:51.690286 24093 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48baacd3c93f4c1cac32b7c3c5a11b39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44161 } }
I20260806 02:21:51.690694 24093 leader_election.cc:302] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48baacd3c93f4c1cac32b7c3c5a11b39; no voters:
I20260806 02:21:51.691082 24093 leader_election.cc:288] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:51.691190 24101 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:51.691457 24101 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [term 1 LEADER]: Becoming Leader. State: Replica: 48baacd3c93f4c1cac32b7c3c5a11b39, State: Running, Role: LEADER
I20260806 02:21:51.691819 24101 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48baacd3c93f4c1cac32b7c3c5a11b39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44161 } }
I20260806 02:21:51.692572 24093 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:51.693670 24102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48baacd3c93f4c1cac32b7c3c5a11b39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48baacd3c93f4c1cac32b7c3c5a11b39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44161 } } }
I20260806 02:21:51.693817 24102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:51.694190 24111 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:51.694128 24103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48baacd3c93f4c1cac32b7c3c5a11b39. Latest consensus state: current_term: 1 leader_uuid: "48baacd3c93f4c1cac32b7c3c5a11b39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48baacd3c93f4c1cac32b7c3c5a11b39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44161 } } }
I20260806 02:21:51.694303 24103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:51.696024 24096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:51.680507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:41759 (local address 127.0.0.1:44161)
0806 02:21:51.680938 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:51.680955 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:51.680992 (+ 37us) server_negotiation.cc:407] Connection header received
0806 02:21:51.681748 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:51.681775 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:51.682117 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:51.682393 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:51.683324 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:51.684349 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:51.685616 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:51.686097 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:51.686214 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:51.689385 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:51.689391 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:51.689408 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:51.689439 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:51.691554 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:51.692226 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:51.692231 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:51.692239 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:51.692377 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:51.692802 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:51.692806 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:51.692808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:51.693343 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:51.694425 (+ 1082us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:51.694654 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 02:21:51.694938 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":152,"threads_started":1}
I20260806 02:21:51.697477 24111 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:51.699365 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:21:51.703445 24111 catalog_manager.cc:1347] Generated new cluster ID: f3e6ce082cfb406ea37419386d47fae1
I20260806 02:21:51.703526 24111 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:51.717303 24111 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:51.718536 24111 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:51.718818 24096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:51.710035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:59601 (local address 127.0.0.1:44161)
0806 02:21:51.710155 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:51.710160 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:51.710419 (+ 259us) server_negotiation.cc:407] Connection header received
0806 02:21:51.710567 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:51.710570 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:51.710623 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:51.710709 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:51.711424 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:51.711958 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:51.712806 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:51.713064 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:51.713176 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:51.714723 (+ 1547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:51.714727 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:51.714730 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:51.714761 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:51.716408 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:51.717371 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:51.717375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:51.717377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:51.717474 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:51.717882 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:51.717885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:51.717887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:51.718095 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:51.718255 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:51.718541 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 02:21:51.718652 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":35}
I20260806 02:21:51.724393 24111 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48baacd3c93f4c1cac32b7c3c5a11b39: Generated new TSK 0
I20260806 02:21:51.725057 24111 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:51.731453 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 23994
W20260806 02:21:51.742166 23971 connection.cc:535] client connection to 127.0.0.1:44161 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44161): Connection reset by peer (error 104)
2026-08-06T02:21:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1653 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:51 dist-test-slave-gkw7 krb5kdc[24134](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:51 dist-test-slave-gkw7 krb5kdc[24134](info): set up 2 sockets
Aug 06 02:21:51 dist-test-slave-gkw7 krb5kdc[24134](info): commencing operation
krb5kdc: starting...
W20260806 02:21:52.947362 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:53 dist-test-slave-gkw7 krb5kdc[24134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 02:21:53.084468 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43375
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43375
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:53.200464 24149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:53.200815 24149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:53.200902 24149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:53.205029 24149 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:53.205154 24149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:53.205193 24149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:53.205232 24149 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:53.205268 24149 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:53.210892 24149 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43375
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:53.212129 24149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:53.213248 24149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:53.222158 24157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:53.222200 24160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:53.222154 24162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:53.222551 24149 server_base.cc:1034] running on GCE node
I20260806 02:21:53.223161 24149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:53.224274 24149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:53.225438 24149 hybrid_clock.cc:648] HybridClock initialized: now 1785982913225407 us; error 45 us; skew 500 ppm
Aug 06 02:21:53 dist-test-slave-gkw7 krb5kdc[24134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982913, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:53.228310 24149 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 02:21:53.229151 24149 webserver.cc:460] Webserver started at http://127.0.0.1:37609/ using document root <none> and password file <none>
I20260806 02:21:53.229764 24149 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:53.229832 24149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:53.230008 24149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:53.232120 24149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "c2c5c86849314e249180b5dd5e08f39f"
format_stamp: "Formatted at 2026-08-06 02:21:53 on dist-test-slave-gkw7"
server_key: "4eda027ac22e57eeae9883b28921309d"
server_key_iv: "8861cb8d08ccefc9f04c60fc34d46002"
server_key_version: "encryptionkey@0"
I20260806 02:21:53.232656 24149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "c2c5c86849314e249180b5dd5e08f39f"
format_stamp: "Formatted at 2026-08-06 02:21:53 on dist-test-slave-gkw7"
server_key: "4eda027ac22e57eeae9883b28921309d"
server_key_iv: "8861cb8d08ccefc9f04c60fc34d46002"
server_key_version: "encryptionkey@0"
I20260806 02:21:53.236558 24149 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 02:21:53.239220 24172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:53.240554 24149 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 02:21:53.240703 24149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "c2c5c86849314e249180b5dd5e08f39f"
format_stamp: "Formatted at 2026-08-06 02:21:53 on dist-test-slave-gkw7"
server_key: "4eda027ac22e57eeae9883b28921309d"
server_key_iv: "8861cb8d08ccefc9f04c60fc34d46002"
server_key_version: "encryptionkey@0"
I20260806 02:21:53.240825 24149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:53.259088 24149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:53.262739 24149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:53.262962 24149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:53.272176 24149 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43375
I20260806 02:21:53.272192 24255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43375 every 8 connection(s)
I20260806 02:21:53.273617 24149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:53.277894 24256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:53.282533 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 24149
I20260806 02:21:53.282707 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:53.283011 27382 external_mini_cluster.cc:1428] Setting key 64f02850e8047dc484b2a998a30b1ab7
I20260806 02:21:53.285115 24256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f: Bootstrap starting.
I20260806 02:21:53.287546 24256 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:53.288344 24256 log.cc:824] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:53.290373 24256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f: No bootstrap required, opened a new log
I20260806 02:21:53.292747 24262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:53.284426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:40445 (local address 127.0.0.1:43375)
0806 02:21:53.284874 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:53.284898 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:53.285169 (+ 271us) server_negotiation.cc:407] Connection header received
0806 02:21:53.286030 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:53.286050 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:53.286413 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:53.286776 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:53.287200 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:53.288233 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:53.289198 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:53.289760 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:53.289927 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:53.290872 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:53.290877 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:53.290891 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:53.291284 (+ 393us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:53.291339 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:53.291361 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:53.291502 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:53.291656 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 02:21:53.291803 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":133,"threads_started":1}
I20260806 02:21:53.293710 24256 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2c5c86849314e249180b5dd5e08f39f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43375 } }
I20260806 02:21:53.293956 24256 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:53.294034 24256 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c5c86849314e249180b5dd5e08f39f, State: Initialized, Role: FOLLOWER
I20260806 02:21:53.294462 24256 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2c5c86849314e249180b5dd5e08f39f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43375 } }
I20260806 02:21:53.294641 24256 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:53.294734 24256 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:53.294859 24256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:53.295886 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:21:53.296022 24256 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2c5c86849314e249180b5dd5e08f39f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43375 } }
I20260806 02:21:53.296377 24256 leader_election.cc:302] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2c5c86849314e249180b5dd5e08f39f; no voters:
I20260806 02:21:53.296718 24256 leader_election.cc:288] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:53.296828 24264 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:53.297060 24264 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [term 1 LEADER]: Becoming Leader. State: Replica: c2c5c86849314e249180b5dd5e08f39f, State: Running, Role: LEADER
I20260806 02:21:53.297518 24264 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2c5c86849314e249180b5dd5e08f39f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43375 } }
I20260806 02:21:53.298097 24256 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:53.298821 24266 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2c5c86849314e249180b5dd5e08f39f. Latest consensus state: current_term: 1 leader_uuid: "c2c5c86849314e249180b5dd5e08f39f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2c5c86849314e249180b5dd5e08f39f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43375 } } }
I20260806 02:21:53.298964 24266 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:53.299393 24275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:53.299335 24265 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2c5c86849314e249180b5dd5e08f39f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2c5c86849314e249180b5dd5e08f39f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43375 } } }
I20260806 02:21:53.299507 24265 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:53.302865 24275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:53.304355 24262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:53.298344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:55921 (local address 127.0.0.1:43375)
0806 02:21:53.298455 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:53.298459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:53.298736 (+ 277us) server_negotiation.cc:407] Connection header received
0806 02:21:53.299664 (+ 928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:53.299668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:53.299725 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:53.299784 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:53.300282 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:53.301138 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:53.302313 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:53.302679 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:53.302793 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:53.303825 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:53.303829 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:53.303831 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:53.303845 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:53.303875 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:53.303889 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:53.303990 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:53.304177 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 02:21:53.304219 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 02:21:53.309003 24275 catalog_manager.cc:1347] Generated new cluster ID: 9b0f1c61de55446d8134cf3c990a4448
I20260806 02:21:53.309082 24275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:53.323419 24275 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:53.324417 24275 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:53.335137 24275 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2c5c86849314e249180b5dd5e08f39f: Generated new TSK 0
I20260806 02:21:53.336012 24275 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:53.340024 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 24149
W20260806 02:21:53.350525 24130 connection.cc:535] client connection to 127.0.0.1:43375 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43375): Connection reset by peer (error 104)
2026-08-06T02:21:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1608 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:53 dist-test-slave-gkw7 krb5kdc[24307](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:53 dist-test-slave-gkw7 krb5kdc[24307](info): set up 2 sockets
Aug 06 02:21:53 dist-test-slave-gkw7 krb5kdc[24307](info): commencing operation
krb5kdc: starting...
W20260806 02:21:54.561184 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:54 dist-test-slave-gkw7 krb5kdc[24307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 02:21:54.696395 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36787
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:54.811611 24326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:54.811947 24326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:54.812031 24326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:54.816064 24326 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:54.816181 24326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:54.816221 24326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:54.816283 24326 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:54.816322 24326 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:54.821703 24326 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:54.822896 24326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:54.823987 24326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:54.833328 24332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:54.833312 24331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:54.833465 24326 server_base.cc:1034] running on GCE node
W20260806 02:21:54.833312 24334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:54.834282 24326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:54.835448 24326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:54.836640 24326 hybrid_clock.cc:648] HybridClock initialized: now 1785982914836608 us; error 42 us; skew 500 ppm
Aug 06 02:21:54 dist-test-slave-gkw7 krb5kdc[24307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982914, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:54.839754 24326 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 02:21:54.840790 24326 webserver.cc:460] Webserver started at http://127.0.0.1:46475/ using document root <none> and password file <none>
I20260806 02:21:54.841464 24326 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:54.841609 24326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:54.841894 24326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:54.844184 24326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "9b8dd8a66e8348a7b5e186042a53d4c3"
format_stamp: "Formatted at 2026-08-06 02:21:54 on dist-test-slave-gkw7"
server_key: "83548209dabb48cd761f81682757b450"
server_key_iv: "6b5fd9f5401fb023ae9552dbff9cc4a2"
server_key_version: "encryptionkey@0"
I20260806 02:21:54.844834 24326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "9b8dd8a66e8348a7b5e186042a53d4c3"
format_stamp: "Formatted at 2026-08-06 02:21:54 on dist-test-slave-gkw7"
server_key: "83548209dabb48cd761f81682757b450"
server_key_iv: "6b5fd9f5401fb023ae9552dbff9cc4a2"
server_key_version: "encryptionkey@0"
I20260806 02:21:54.848959 24326 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:21:54.851759 24341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:54.853138 24326 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 02:21:54.853315 24326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "9b8dd8a66e8348a7b5e186042a53d4c3"
format_stamp: "Formatted at 2026-08-06 02:21:54 on dist-test-slave-gkw7"
server_key: "83548209dabb48cd761f81682757b450"
server_key_iv: "6b5fd9f5401fb023ae9552dbff9cc4a2"
server_key_version: "encryptionkey@0"
I20260806 02:21:54.853458 24326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:54.858904 24326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:54.862170 24326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:54.862382 24326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:54.870398 24326 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36787
I20260806 02:21:54.870446 24413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36787 every 8 connection(s)
I20260806 02:21:54.871486 24326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:54.874197 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 24326
I20260806 02:21:54.874356 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:54.874591 24415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:54.874737 27382 external_mini_cluster.cc:1428] Setting key a97ea823f09162e75c35ab420d7d9e7a
I20260806 02:21:54.880086 24419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:54.876222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:53539 (local address 127.0.0.1:36787)
0806 02:21:54.876684 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:54.876699 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:54.876735 (+ 36us) server_negotiation.cc:407] Connection header received
0806 02:21:54.877334 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:54.877350 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:54.877713 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:54.878054 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:54.878904 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:54.878909 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:54.878921 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:54.878932 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:54.878984 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:54.879004 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:54.879164 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:54.879240 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 02:21:54.879403 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":138,"threads_started":1}
I20260806 02:21:54.881449 24415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3: Bootstrap starting.
I20260806 02:21:54.883095 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:21:54.884027 24415 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:54.884883 24415 log.cc:824] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:54.887018 24419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:54.885226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:42323 (local address 127.0.0.1:36787)
0806 02:21:54.885346 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:54.885350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:54.885592 (+ 242us) server_negotiation.cc:407] Connection header received
0806 02:21:54.885754 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:54.885757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:54.885791 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:54.885884 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:54.886607 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:54.886611 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:54.886613 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:54.886626 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:54.886654 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:54.886667 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:54.886758 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:54.886857 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 02:21:54.886900 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 02:21:54.887226 24415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3: No bootstrap required, opened a new log
I20260806 02:21:54.890801 24415 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b8dd8a66e8348a7b5e186042a53d4c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36787 } }
I20260806 02:21:54.891026 24415 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:54.891120 24415 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b8dd8a66e8348a7b5e186042a53d4c3, State: Initialized, Role: FOLLOWER
I20260806 02:21:54.891564 24415 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b8dd8a66e8348a7b5e186042a53d4c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36787 } }
I20260806 02:21:54.891693 24415 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:54.891741 24415 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:54.891810 24415 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:54.892880 24415 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b8dd8a66e8348a7b5e186042a53d4c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36787 } }
I20260806 02:21:54.893251 24415 leader_election.cc:302] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b8dd8a66e8348a7b5e186042a53d4c3; no voters:
I20260806 02:21:54.893568 24415 leader_election.cc:288] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:54.893667 24429 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:54.893951 24429 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [term 1 LEADER]: Becoming Leader. State: Replica: 9b8dd8a66e8348a7b5e186042a53d4c3, State: Running, Role: LEADER
I20260806 02:21:54.894275 24429 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b8dd8a66e8348a7b5e186042a53d4c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36787 } }
I20260806 02:21:54.894872 24415 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:54.895944 24430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b8dd8a66e8348a7b5e186042a53d4c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b8dd8a66e8348a7b5e186042a53d4c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36787 } } }
I20260806 02:21:54.896075 24430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:54.896380 24431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b8dd8a66e8348a7b5e186042a53d4c3. Latest consensus state: current_term: 1 leader_uuid: "9b8dd8a66e8348a7b5e186042a53d4c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b8dd8a66e8348a7b5e186042a53d4c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36787 } } }
I20260806 02:21:54.896473 24431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:54.896574 24439 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:54.899842 24439 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:54.905634 24439 catalog_manager.cc:1347] Generated new cluster ID: 66f6ae54a0554f98ad13880ca22de914
I20260806 02:21:54.905709 24439 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:54.921262 24439 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:54.921662 24439 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:54.937736 24439 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b8dd8a66e8348a7b5e186042a53d4c3: Generated new TSK 0
I20260806 02:21:54.938706 24439 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:54.945685 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 24326
2026-08-06T02:21:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1609 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:55 dist-test-slave-gkw7 krb5kdc[24459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:55 dist-test-slave-gkw7 krb5kdc[24459](info): set up 2 sockets
Aug 06 02:21:55 dist-test-slave-gkw7 krb5kdc[24459](info): commencing operation
krb5kdc: starting...
W20260806 02:21:56.196697 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:56 dist-test-slave-gkw7 krb5kdc[24459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 02:21:56.333391 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37031
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:56.448520 24477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:56.448868 24477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:56.448954 24477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:56.452960 24477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:56.453071 24477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:56.453107 24477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:56.453177 24477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:56.453219 24477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:56.458534 24477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37031
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:56.459721 24477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:56.460850 24477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:56.469769 24489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:56.469769 24483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:56.469822 24477 server_base.cc:1034] running on GCE node
W20260806 02:21:56.469838 24486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:56.470692 24477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:56.471809 24477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:56.473004 24477 hybrid_clock.cc:648] HybridClock initialized: now 1785982916472993 us; error 32 us; skew 500 ppm
Aug 06 02:21:56 dist-test-slave-gkw7 krb5kdc[24459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982916, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:56.481968 24477 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 02:21:56.483055 24477 webserver.cc:460] Webserver started at http://127.0.0.1:42123/ using document root <none> and password file <none>
I20260806 02:21:56.483687 24477 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:56.483788 24477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:56.484041 24477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:56.486277 24477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "e54699035d73402988acd7a19a554e15"
format_stamp: "Formatted at 2026-08-06 02:21:56 on dist-test-slave-gkw7"
server_key: "ac5a89c0941dc8815fcf9a53e8cbbf89"
server_key_iv: "06c90c9354abbcd69a1ff1209dd3c07d"
server_key_version: "encryptionkey@0"
I20260806 02:21:56.486877 24477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "e54699035d73402988acd7a19a554e15"
format_stamp: "Formatted at 2026-08-06 02:21:56 on dist-test-slave-gkw7"
server_key: "ac5a89c0941dc8815fcf9a53e8cbbf89"
server_key_iv: "06c90c9354abbcd69a1ff1209dd3c07d"
server_key_version: "encryptionkey@0"
I20260806 02:21:56.490763 24477 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260806 02:21:56.493261 24499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:56.494575 24477 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:56.494741 24477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "e54699035d73402988acd7a19a554e15"
format_stamp: "Formatted at 2026-08-06 02:21:56 on dist-test-slave-gkw7"
server_key: "ac5a89c0941dc8815fcf9a53e8cbbf89"
server_key_iv: "06c90c9354abbcd69a1ff1209dd3c07d"
server_key_version: "encryptionkey@0"
I20260806 02:21:56.494879 24477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:56.506508 24477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:56.509315 24477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:56.509582 24477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:56.516932 24477 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37031
I20260806 02:21:56.516940 24567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37031 every 8 connection(s)
I20260806 02:21:56.517990 24477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:56.520767 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 24477
I20260806 02:21:56.520928 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:56.520922 24569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:56.521277 27382 external_mini_cluster.cc:1428] Setting key 8670a3eabe37e2ab75e5b079c2e195a3
I20260806 02:21:56.527777 24569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15: Bootstrap starting.
I20260806 02:21:56.530620 24569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15: Neither blocks nor log segments found. Creating new log.
Aug 06 02:21:56 dist-test-slave-gkw7 krb5kdc[24459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 02:21:56.531416 24569 log.cc:824] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:56.533345 24569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15: No bootstrap required, opened a new log
I20260806 02:21:56.536437 24575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:56.522702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:36097 (local address 127.0.0.1:37031)
0806 02:21:56.523170 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:56.523185 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:56.523225 (+ 40us) server_negotiation.cc:407] Connection header received
0806 02:21:56.524179 (+ 954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:56.524199 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:56.524545 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:56.524826 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:56.525821 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:56.526825 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:56.527996 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:56.528462 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:56.528586 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:56.531596 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:56.531602 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:56.531619 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:56.531649 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:56.533490 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:56.534105 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:56.534110 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:56.534114 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:56.534218 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:56.534576 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:56.534578 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:56.534579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:56.534958 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:56.535112 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:56.535464 (+ 352us) server_negotiation.cc:299] Negotiation successful
0806 02:21:56.535687 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":149,"threads_started":1}
I20260806 02:21:56.537808 24569 raft_consensus.cc:348] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54699035d73402988acd7a19a554e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37031 } }
I20260806 02:21:56.538096 24569 raft_consensus.cc:374] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:56.538169 24569 raft_consensus.cc:729] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54699035d73402988acd7a19a554e15, State: Initialized, Role: FOLLOWER
I20260806 02:21:56.538604 24569 consensus_queue.cc:260] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54699035d73402988acd7a19a554e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37031 } }
I20260806 02:21:56.538769 24569 raft_consensus.cc:388] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:56.538892 24569 raft_consensus.cc:482] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:56.539004 24569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:56.539592 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:21:56.540138 24569 raft_consensus.cc:504] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54699035d73402988acd7a19a554e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37031 } }
I20260806 02:21:56.540511 24569 leader_election.cc:302] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e54699035d73402988acd7a19a554e15; no voters:
I20260806 02:21:56.540892 24569 leader_election.cc:288] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:56.541091 24577 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:56.541404 24577 raft_consensus.cc:686] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [term 1 LEADER]: Becoming Leader. State: Replica: e54699035d73402988acd7a19a554e15, State: Running, Role: LEADER
I20260806 02:21:56.541733 24577 consensus_queue.cc:237] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54699035d73402988acd7a19a554e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37031 } }
I20260806 02:21:56.542323 24569 sys_catalog.cc:564] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:56.543119 24577 sys_catalog.cc:455] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e54699035d73402988acd7a19a554e15. Latest consensus state: current_term: 1 leader_uuid: "e54699035d73402988acd7a19a554e15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54699035d73402988acd7a19a554e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37031 } } }
I20260806 02:21:56.543238 24577 sys_catalog.cc:458] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:56.543578 24583 sys_catalog.cc:455] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e54699035d73402988acd7a19a554e15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54699035d73402988acd7a19a554e15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37031 } } }
I20260806 02:21:56.543692 24583 sys_catalog.cc:458] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:56.543632 24593 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:56.547147 24593 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:56.553275 24575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:56.541933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:54695 (local address 127.0.0.1:37031)
0806 02:21:56.542053 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:56.542057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:56.543981 (+ 1924us) server_negotiation.cc:407] Connection header received
0806 02:21:56.544178 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:56.544183 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:56.544231 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:56.544315 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:56.545461 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:56.546256 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:56.547395 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:56.547754 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:56.547867 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:56.549659 (+ 1792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:56.549665 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:56.549668 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:21:56.549700 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:56.551221 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:56.551756 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:56.551761 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:56.551763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:56.551856 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:21:56.552268 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:21:56.552272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:21:56.552274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:21:56.552505 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:56.552654 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:56.552997 (+ 343us) server_negotiation.cc:299] Negotiation successful
0806 02:21:56.553107 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 02:21:56.554200 24593 catalog_manager.cc:1347] Generated new cluster ID: f9c7cdfb7b4c4bc19317403a2629e31e
I20260806 02:21:56.554278 24593 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:56.567279 24593 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:56.568218 24593 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:56.585165 24593 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e54699035d73402988acd7a19a554e15: Generated new TSK 0
I20260806 02:21:56.586021 24593 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:56.596593 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 24477
W20260806 02:21:56.607672 24457 connection.cc:535] client connection to 127.0.0.1:37031 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37031): Connection reset by peer (error 104)
2026-08-06T02:21:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1647 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:56 dist-test-slave-gkw7 krb5kdc[24611](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:56 dist-test-slave-gkw7 krb5kdc[24611](info): set up 2 sockets
Aug 06 02:21:56 dist-test-slave-gkw7 krb5kdc[24611](info): commencing operation
krb5kdc: starting...
W20260806 02:21:57.805078 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:57 dist-test-slave-gkw7 krb5kdc[24611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 02:21:57.945073 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45107
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45107
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:58.063774 24637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:58.064126 24637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:58.064219 24637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:58.068465 24637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:58.068586 24637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:58.068626 24637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:58.068663 24637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:58.068692 24637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:58.074472 24637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45107
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:58.075670 24637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:58.076758 24637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:58.086154 24642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:58.086217 24637 server_base.cc:1034] running on GCE node
W20260806 02:21:58.086232 24645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:58.086154 24643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:58.087033 24637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:58.088223 24637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:58.089432 24637 hybrid_clock.cc:648] HybridClock initialized: now 1785982918089417 us; error 31 us; skew 500 ppm
Aug 06 02:21:58 dist-test-slave-gkw7 krb5kdc[24611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982918, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:58.092448 24637 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 02:21:58.093380 24637 webserver.cc:460] Webserver started at http://127.0.0.1:42171/ using document root <none> and password file <none>
I20260806 02:21:58.094014 24637 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:58.094116 24637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:58.094364 24637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:58.096482 24637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "c69c6914e6f64e5181863f02952c29e8"
format_stamp: "Formatted at 2026-08-06 02:21:58 on dist-test-slave-gkw7"
server_key: "76bc4865e91c0017b3013cc745db8b0a"
server_key_iv: "0ac8ea990b7bcc071e976a91ca093eaf"
server_key_version: "encryptionkey@0"
I20260806 02:21:58.097072 24637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "c69c6914e6f64e5181863f02952c29e8"
format_stamp: "Formatted at 2026-08-06 02:21:58 on dist-test-slave-gkw7"
server_key: "76bc4865e91c0017b3013cc745db8b0a"
server_key_iv: "0ac8ea990b7bcc071e976a91ca093eaf"
server_key_version: "encryptionkey@0"
I20260806 02:21:58.101001 24637 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:21:58.103645 24656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:58.104986 24637 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:21:58.105162 24637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "c69c6914e6f64e5181863f02952c29e8"
format_stamp: "Formatted at 2026-08-06 02:21:58 on dist-test-slave-gkw7"
server_key: "76bc4865e91c0017b3013cc745db8b0a"
server_key_iv: "0ac8ea990b7bcc071e976a91ca093eaf"
server_key_version: "encryptionkey@0"
I20260806 02:21:58.105285 24637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:58.125772 24637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:58.129042 24637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:58.129269 24637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:58.136842 24637 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45107
I20260806 02:21:58.136971 24734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45107 every 8 connection(s)
I20260806 02:21:58.137933 24637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:58.140957 24736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:58.143270 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 24637
I20260806 02:21:58.143440 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:58.143771 27382 external_mini_cluster.cc:1428] Setting key 5c96624fc3362a3d992b16ed6ff1a120
I20260806 02:21:58.147584 24736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8: Bootstrap starting.
I20260806 02:21:58.150202 24736 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:58.151109 24736 log.cc:824] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:58.153329 24736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8: No bootstrap required, opened a new log
I20260806 02:21:58.153455 24739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:58.145270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:51207 (local address 127.0.0.1:45107)
0806 02:21:58.145779 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:58.145796 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:58.145834 (+ 38us) server_negotiation.cc:407] Connection header received
0806 02:21:58.146669 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:58.146690 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:58.147064 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:58.147379 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:58.147787 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:58.148828 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:58.150074 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:58.150631 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:58.150766 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:58.151767 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:58.151772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:58.151785 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:58.152171 (+ 386us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:58.152228 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:58.152259 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:58.152406 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:58.152578 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 02:21:58.152719 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":172,"threads_started":1}
I20260806 02:21:58.156538 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:21:58.157863 24736 raft_consensus.cc:348] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69c6914e6f64e5181863f02952c29e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45107 } }
I20260806 02:21:58.158139 24736 raft_consensus.cc:374] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:58.158226 24736 raft_consensus.cc:729] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c69c6914e6f64e5181863f02952c29e8, State: Initialized, Role: FOLLOWER
I20260806 02:21:58.158816 24736 consensus_queue.cc:260] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69c6914e6f64e5181863f02952c29e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45107 } }
I20260806 02:21:58.159044 24736 raft_consensus.cc:388] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:58.159132 24736 raft_consensus.cc:482] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:58.159247 24736 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:58.160339 24736 raft_consensus.cc:504] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69c6914e6f64e5181863f02952c29e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45107 } }
I20260806 02:21:58.160720 24736 leader_election.cc:302] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c69c6914e6f64e5181863f02952c29e8; no voters:
I20260806 02:21:58.161058 24736 leader_election.cc:288] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:58.161180 24748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:58.161453 24748 raft_consensus.cc:686] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [term 1 LEADER]: Becoming Leader. State: Replica: c69c6914e6f64e5181863f02952c29e8, State: Running, Role: LEADER
I20260806 02:21:58.161780 24748 consensus_queue.cc:237] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69c6914e6f64e5181863f02952c29e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45107 } }
I20260806 02:21:58.162679 24736 sys_catalog.cc:564] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:58.163468 24739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:58.158761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:50731 (local address 127.0.0.1:45107)
0806 02:21:58.158915 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:58.158920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:58.159099 (+ 179us) server_negotiation.cc:407] Connection header received
0806 02:21:58.159255 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:58.159258 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:58.159311 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:58.159393 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:58.159697 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:58.160239 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:58.161300 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:21:58.161696 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:21:58.161837 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:21:58.162752 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:58.162758 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:58.162761 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:58.162776 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:58.162808 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:58.162824 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:58.162931 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:58.163297 (+ 366us) server_negotiation.cc:299] Negotiation successful
0806 02:21:58.163337 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":74}
I20260806 02:21:58.163569 24749 sys_catalog.cc:455] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c69c6914e6f64e5181863f02952c29e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69c6914e6f64e5181863f02952c29e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45107 } } }
I20260806 02:21:58.163702 24749 sys_catalog.cc:458] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:58.164021 24750 sys_catalog.cc:455] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c69c6914e6f64e5181863f02952c29e8. Latest consensus state: current_term: 1 leader_uuid: "c69c6914e6f64e5181863f02952c29e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69c6914e6f64e5181863f02952c29e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45107 } } }
I20260806 02:21:58.164141 24750 sys_catalog.cc:458] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:58.164999 24755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:58.167980 24755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:58.173868 24755 catalog_manager.cc:1347] Generated new cluster ID: deeaef8156c142c6a1dc1fa7a98c36e4
I20260806 02:21:58.173943 24755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:58.180752 24755 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:58.182041 24755 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:58.187788 24755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c69c6914e6f64e5181863f02952c29e8: Generated new TSK 0
I20260806 02:21:58.188540 24755 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:58.194366 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 24637
W20260806 02:21:58.204962 24607 connection.cc:535] client connection to 127.0.0.1:45107 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45107): Connection reset by peer (error 104)
2026-08-06T02:21:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1597 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:58 dist-test-slave-gkw7 krb5kdc[24779](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:58 dist-test-slave-gkw7 krb5kdc[24779](info): set up 2 sockets
Aug 06 02:21:58 dist-test-slave-gkw7 krb5kdc[24779](info): commencing operation
krb5kdc: starting...
W20260806 02:21:59.537204 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.317s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:21:59 dist-test-slave-gkw7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:21:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:21:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 02:21:59.669019 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36651
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36651
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:21:59.782699 24797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:21:59.782992 24797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:21:59.783064 24797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:21:59.787092 24797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:21:59.787179 24797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:21:59.787218 24797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:21:59.787273 24797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:21:59.787312 24797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:21:59.792433 24797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36651
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:21:59.793466 24797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:21:59.794498 24797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:21:59.803457 24806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:21:59.803467 24808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:59.803593 24797 server_base.cc:1034] running on GCE node
W20260806 02:21:59.803510 24805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:21:59.804441 24797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:21:59.805684 24797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:21:59.806897 24797 hybrid_clock.cc:648] HybridClock initialized: now 1785982919806882 us; error 36 us; skew 500 ppm
Aug 06 02:21:59 dist-test-slave-gkw7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982919, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:21:59.809978 24797 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 02:21:59.810994 24797 webserver.cc:460] Webserver started at http://127.0.0.1:45383/ using document root <none> and password file <none>
I20260806 02:21:59.811625 24797 fs_manager.cc:359] Metadata directory not provided
I20260806 02:21:59.811728 24797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:21:59.811990 24797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:21:59.814391 24797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "ff9683cf82b748fa88416496fa9d6147"
format_stamp: "Formatted at 2026-08-06 02:21:59 on dist-test-slave-gkw7"
server_key: "21ef1584d7701b2414313bff0da1f91c"
server_key_iv: "0171bd38f97f4290f1b0cc751058c325"
server_key_version: "encryptionkey@0"
I20260806 02:21:59.815016 24797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "ff9683cf82b748fa88416496fa9d6147"
format_stamp: "Formatted at 2026-08-06 02:21:59 on dist-test-slave-gkw7"
server_key: "21ef1584d7701b2414313bff0da1f91c"
server_key_iv: "0171bd38f97f4290f1b0cc751058c325"
server_key_version: "encryptionkey@0"
I20260806 02:21:59.819211 24797 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:21:59.822140 24815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:21:59.823475 24797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:21:59.823666 24797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "ff9683cf82b748fa88416496fa9d6147"
format_stamp: "Formatted at 2026-08-06 02:21:59 on dist-test-slave-gkw7"
server_key: "21ef1584d7701b2414313bff0da1f91c"
server_key_iv: "0171bd38f97f4290f1b0cc751058c325"
server_key_version: "encryptionkey@0"
I20260806 02:21:59.823796 24797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:21:59.828922 24797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:21:59.832306 24797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:21:59.832525 24797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:21:59.840716 24797 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36651
I20260806 02:21:59.840734 24887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36651 every 8 connection(s)
I20260806 02:21:59.841856 24797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:21:59.844923 24888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:21:59.845875 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 24797
I20260806 02:21:59.846091 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:21:59.846490 27382 external_mini_cluster.cc:1428] Setting key 0bc53faefd5a310e3e1b11d5278bd336
I20260806 02:21:59.852154 24888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147: Bootstrap starting.
I20260806 02:21:59.852339 24893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:59.848129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:41313 (local address 127.0.0.1:36651)
0806 02:21:59.848611 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:59.848628 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:59.848666 (+ 38us) server_negotiation.cc:407] Connection header received
0806 02:21:59.849358 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:59.849377 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:59.849760 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:59.850149 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:59.851014 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:59.851020 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:59.851032 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:59.851044 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:59.851109 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:59.851130 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:59.851301 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:59.851379 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 02:21:59.851553 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":152,"threads_started":1}
I20260806 02:21:59.854962 24888 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147: Neither blocks nor log segments found. Creating new log.
I20260806 02:21:59.855594 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:21:59.855903 24888 log.cc:824] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147: Log is configured to *not* fsync() on all Append() calls
I20260806 02:21:59.858316 24888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147: No bootstrap required, opened a new log
I20260806 02:21:59.859555 24893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:21:59.857739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:40733 (local address 127.0.0.1:36651)
0806 02:21:59.857856 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 02:21:59.857860 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:21:59.858044 (+ 184us) server_negotiation.cc:407] Connection header received
0806 02:21:59.858194 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:21:59.858197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:21:59.858236 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:21:59.858320 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:21:59.859090 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:21:59.859093 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:21:59.859095 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:21:59.859106 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:21:59.859137 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:21:59.859147 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:21:59.859237 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 02:21:59.859369 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 02:21:59.859407 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 02:21:59.862703 24888 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9683cf82b748fa88416496fa9d6147" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36651 } }
I20260806 02:21:59.862955 24888 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:21:59.863040 24888 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff9683cf82b748fa88416496fa9d6147, State: Initialized, Role: FOLLOWER
I20260806 02:21:59.863569 24888 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9683cf82b748fa88416496fa9d6147" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36651 } }
I20260806 02:21:59.863747 24888 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:21:59.863839 24888 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:21:59.863994 24888 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:21:59.865113 24888 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9683cf82b748fa88416496fa9d6147" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36651 } }
I20260806 02:21:59.865492 24888 leader_election.cc:302] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff9683cf82b748fa88416496fa9d6147; no voters:
I20260806 02:21:59.865899 24888 leader_election.cc:288] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:21:59.866006 24901 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:21:59.866289 24901 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [term 1 LEADER]: Becoming Leader. State: Replica: ff9683cf82b748fa88416496fa9d6147, State: Running, Role: LEADER
I20260806 02:21:59.866627 24901 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9683cf82b748fa88416496fa9d6147" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36651 } }
I20260806 02:21:59.867304 24888 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:21:59.868311 24905 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff9683cf82b748fa88416496fa9d6147" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9683cf82b748fa88416496fa9d6147" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36651 } } }
I20260806 02:21:59.868449 24905 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:59.868867 24906 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff9683cf82b748fa88416496fa9d6147. Latest consensus state: current_term: 1 leader_uuid: "ff9683cf82b748fa88416496fa9d6147" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9683cf82b748fa88416496fa9d6147" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36651 } } }
I20260806 02:21:59.868965 24906 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147 [sys.catalog]: This master's current role is: LEADER
I20260806 02:21:59.869311 24914 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:21:59.872022 24914 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:21:59.877856 24914 catalog_manager.cc:1347] Generated new cluster ID: ad80258b8c9b4890a351fb04d80a1825
I20260806 02:21:59.877925 24914 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:21:59.885118 24914 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:21:59.885488 24914 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:21:59.891585 24914 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff9683cf82b748fa88416496fa9d6147: Generated new TSK 0
I20260806 02:21:59.892313 24914 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:21:59.901193 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 24797
2026-08-06T02:21:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1708 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:21:59 dist-test-slave-gkw7 krb5kdc[24932](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:21:59 dist-test-slave-gkw7 krb5kdc[24932](info): set up 2 sockets
Aug 06 02:21:59 dist-test-slave-gkw7 krb5kdc[24932](info): commencing operation
krb5kdc: starting...
W20260806 02:22:01.142458 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:22:01 dist-test-slave-gkw7 krb5kdc[24932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:22:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:22:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:22:01.290311 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39043
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:39043
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:22:01.406921 24947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:22:01.407244 24947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:22:01.407287 24947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:22:01.411831 24947 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:22:01.411921 24947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:22:01.411965 24947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:22:01.412000 24947 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:22:01.412032 24947 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:22:01.419100 24947 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:39043
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:39043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24947
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:22:01.420274 24947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:22:01.421371 24947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:22:01.430531 24955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:01.430651 24947 server_base.cc:1034] running on GCE node
W20260806 02:22:01.430510 24953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:01.430514 24959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:01.431478 24947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:22:01.432669 24947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:22:01.433835 24947 hybrid_clock.cc:648] HybridClock initialized: now 1785982921433822 us; error 30 us; skew 500 ppm
Aug 06 02:22:01 dist-test-slave-gkw7 krb5kdc[24932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982921, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:22:01.436758 24947 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:22:01.437755 24947 webserver.cc:460] Webserver started at http://127.26.189.190:42249/ using document root <none> and password file <none>
I20260806 02:22:01.438335 24947 fs_manager.cc:359] Metadata directory not provided
I20260806 02:22:01.438431 24947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:22:01.438688 24947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:22:01.440799 24947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "c30ce8f8b2654cea8577907abd274303"
format_stamp: "Formatted at 2026-08-06 02:22:01 on dist-test-slave-gkw7"
server_key: "2ed2f3e15ada34953d31395b7ba2a8bd"
server_key_iv: "9b218507180659968475d9c79a032dbb"
server_key_version: "encryptionkey@0"
I20260806 02:22:01.441414 24947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "c30ce8f8b2654cea8577907abd274303"
format_stamp: "Formatted at 2026-08-06 02:22:01 on dist-test-slave-gkw7"
server_key: "2ed2f3e15ada34953d31395b7ba2a8bd"
server_key_iv: "9b218507180659968475d9c79a032dbb"
server_key_version: "encryptionkey@0"
I20260806 02:22:01.445297 24947 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260806 02:22:01.447928 24969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:22:01.449263 24947 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:22:01.449406 24947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "c30ce8f8b2654cea8577907abd274303"
format_stamp: "Formatted at 2026-08-06 02:22:01 on dist-test-slave-gkw7"
server_key: "2ed2f3e15ada34953d31395b7ba2a8bd"
server_key_iv: "9b218507180659968475d9c79a032dbb"
server_key_version: "encryptionkey@0"
I20260806 02:22:01.449517 24947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:22:01.465922 24947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:22:01.469257 24947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:22:01.469476 24947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:22:01.477135 24947 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:39043
I20260806 02:22:01.477165 25037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:39043 every 8 connection(s)
I20260806 02:22:01.478204 24947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:22:01.481464 25039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:22:01.488018 25039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303: Bootstrap starting.
I20260806 02:22:01.488524 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 24947
I20260806 02:22:01.488703 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:22:01.488991 27382 external_mini_cluster.cc:1428] Setting key 04f8d9cb70f01ebf171b137151888297
I20260806 02:22:01.491142 25039 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303: Neither blocks nor log segments found. Creating new log.
I20260806 02:22:01.491979 25039 log.cc:824] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303: Log is configured to *not* fsync() on all Append() calls
I20260806 02:22:01.494231 25039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303: No bootstrap required, opened a new log
I20260806 02:22:01.498494 25039 raft_consensus.cc:348] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30ce8f8b2654cea8577907abd274303" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39043 } }
I20260806 02:22:01.498782 25039 raft_consensus.cc:374] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:22:01.498901 25039 raft_consensus.cc:729] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c30ce8f8b2654cea8577907abd274303, State: Initialized, Role: FOLLOWER
I20260806 02:22:01.499435 25039 consensus_queue.cc:260] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30ce8f8b2654cea8577907abd274303" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39043 } }
I20260806 02:22:01.499610 25039 raft_consensus.cc:388] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:22:01.499711 25039 raft_consensus.cc:482] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:22:01.499828 25039 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:22:01.500845 25039 raft_consensus.cc:504] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30ce8f8b2654cea8577907abd274303" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39043 } }
I20260806 02:22:01.501281 25039 leader_election.cc:302] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c30ce8f8b2654cea8577907abd274303; no voters:
I20260806 02:22:01.501742 25039 leader_election.cc:288] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:22:01.501858 25045 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:22:01.502141 25045 raft_consensus.cc:686] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [term 1 LEADER]: Becoming Leader. State: Replica: c30ce8f8b2654cea8577907abd274303, State: Running, Role: LEADER
I20260806 02:22:01.502453 25045 consensus_queue.cc:237] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30ce8f8b2654cea8577907abd274303" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39043 } }
Aug 06 02:22:01 dist-test-slave-gkw7 krb5kdc[24932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:22:01.503372 25039 sys_catalog.cc:564] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:22:01.504096 25047 sys_catalog.cc:455] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c30ce8f8b2654cea8577907abd274303. Latest consensus state: current_term: 1 leader_uuid: "c30ce8f8b2654cea8577907abd274303" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30ce8f8b2654cea8577907abd274303" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39043 } } }
I20260806 02:22:01.504246 25047 sys_catalog.cc:458] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:01.504097 25046 sys_catalog.cc:455] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c30ce8f8b2654cea8577907abd274303" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30ce8f8b2654cea8577907abd274303" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 39043 } } }
I20260806 02:22:01.504334 25046 sys_catalog.cc:458] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303 [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:01.506481 25050 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:22:01.510437 25050 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:22:01.511125 25043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:01.490480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44843 (local address 127.26.189.190:39043)
0806 02:22:01.490971 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:01.490987 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:01.491022 (+ 35us) server_negotiation.cc:407] Connection header received
0806 02:22:01.491707 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:01.491727 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:01.492077 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:01.492451 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:01.493268 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:01.494317 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:01.495238 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:01.495717 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:01.495903 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:01.504286 (+ 8383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:01.504296 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:01.504320 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:01.504367 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:01.506931 (+ 2564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:01.507477 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:01.507485 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:01.507492 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:01.507672 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:01.508048 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:01.508053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:01.508056 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:01.508669 (+ 613us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:01.509756 (+ 1087us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:01.509935 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 02:22:01.510167 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":151,"threads_started":1}
I20260806 02:22:01.515784 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:22:01.516928 25050 catalog_manager.cc:1347] Generated new cluster ID: 70515cc880fb49aa839fae85cfaf471b
I20260806 02:22:01.516999 25050 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:22:01.527976 25043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:01.518130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60819 (local address 127.26.189.190:39043)
0806 02:22:01.518232 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:01.518237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:01.518575 (+ 338us) server_negotiation.cc:407] Connection header received
0806 02:22:01.518709 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:01.518712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:01.518760 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:01.518846 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:01.519760 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:01.520561 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:01.521857 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:01.522226 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:01.522344 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:01.524161 (+ 1817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:01.524165 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:01.524168 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:01.524193 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:01.525992 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:01.526588 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:01.526592 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:01.526593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:01.526679 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:01.527060 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:01.527064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:01.527066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:01.527275 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:01.527416 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:01.527720 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 02:22:01.527818 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 02:22:01.540374 25050 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:22:01.541386 25050 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:22:01.555616 25050 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c30ce8f8b2654cea8577907abd274303: Generated new TSK 0
I20260806 02:22:01.556384 25050 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:22:01.565676 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 24947
W20260806 02:22:01.576603 24928 connection.cc:535] client connection to 127.26.189.190:39043 recv error: Network error: failed to read from TLS socket (remote: 127.26.189.190:39043): Connection reset by peer (error 104)
2026-08-06T02:22:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1662 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:22:01 dist-test-slave-gkw7 krb5kdc[25079](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:22:01 dist-test-slave-gkw7 krb5kdc[25079](info): set up 2 sockets
Aug 06 02:22:01 dist-test-slave-gkw7 krb5kdc[25079](info): commencing operation
krb5kdc: starting...
W20260806 02:22:02.769809 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:22:02 dist-test-slave-gkw7 krb5kdc[25079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:22:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:22:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:22:02.896503 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:44217
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:40207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:44217
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:22:03.010337 25096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:22:03.010600 25096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:22:03.010653 25096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:22:03.014604 25096 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:22:03.014665 25096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:22:03.014691 25096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:22:03.014709 25096 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:22:03.014724 25096 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:22:03.019855 25096 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:40207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:44217
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:44217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:22:03.020860 25096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:22:03.021947 25096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:22:03.030567 25106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:03.030586 25109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:03.030700 25096 server_base.cc:1034] running on GCE node
W20260806 02:22:03.030877 25107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:03.031464 25096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:22:03.032626 25096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:22:03.033839 25096 hybrid_clock.cc:648] HybridClock initialized: now 1785982923033814 us; error 35 us; skew 500 ppm
Aug 06 02:22:03 dist-test-slave-gkw7 krb5kdc[25079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982923, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:22:03.036903 25096 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:22:03.037916 25096 webserver.cc:460] Webserver started at http://127.26.189.190:37935/ using document root <none> and password file <none>
I20260806 02:22:03.038546 25096 fs_manager.cc:359] Metadata directory not provided
I20260806 02:22:03.038655 25096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:22:03.038913 25096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:22:03.041113 25096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "18c54d04380e45e0bfa465c4b6f36310"
format_stamp: "Formatted at 2026-08-06 02:22:03 on dist-test-slave-gkw7"
server_key: "291990360fd8a12e16067b9a95244f5f"
server_key_iv: "efc3ae6938fbbfd0d279c639773d97c3"
server_key_version: "encryptionkey@0"
I20260806 02:22:03.041834 25096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "18c54d04380e45e0bfa465c4b6f36310"
format_stamp: "Formatted at 2026-08-06 02:22:03 on dist-test-slave-gkw7"
server_key: "291990360fd8a12e16067b9a95244f5f"
server_key_iv: "efc3ae6938fbbfd0d279c639773d97c3"
server_key_version: "encryptionkey@0"
I20260806 02:22:03.046007 25096 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260806 02:22:03.048554 25117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:22:03.049950 25096 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:22:03.050091 25096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "18c54d04380e45e0bfa465c4b6f36310"
format_stamp: "Formatted at 2026-08-06 02:22:03 on dist-test-slave-gkw7"
server_key: "291990360fd8a12e16067b9a95244f5f"
server_key_iv: "efc3ae6938fbbfd0d279c639773d97c3"
server_key_version: "encryptionkey@0"
I20260806 02:22:03.050210 25096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:22:03.104581 25096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:22:03.108165 25096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:22:03.108392 25096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:22:03.115892 25096 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:44217
I20260806 02:22:03.115924 25188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:44217 every 8 connection(s)
I20260806 02:22:03.116932 25096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:22:03.119868 25189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:22:03.124279 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 25096
I20260806 02:22:03.124413 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:22:03.124750 27382 external_mini_cluster.cc:1428] Setting key 0333ba1c25f28b043c2c51b0bf0e6575
I20260806 02:22:03.126401 25189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310: Bootstrap starting.
I20260806 02:22:03.129285 25189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310: Neither blocks nor log segments found. Creating new log.
I20260806 02:22:03.130249 25189 log.cc:824] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310: Log is configured to *not* fsync() on all Append() calls
I20260806 02:22:03.132490 25189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310: No bootstrap required, opened a new log
I20260806 02:22:03.135902 25192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:03.126387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36701 (local address 127.26.189.190:44217)
0806 02:22:03.126889 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:03.126908 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:03.126950 (+ 42us) server_negotiation.cc:407] Connection header received
0806 02:22:03.127884 (+ 934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:03.127908 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:03.128357 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:03.128728 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:03.129168 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:03.130739 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:03.131759 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:03.132439 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:03.132610 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:03.133631 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:03.133637 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:03.133654 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:22:03.134210 (+ 556us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:03.134282 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:22:03.134313 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:03.134464 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:03.134681 (+ 217us) server_negotiation.cc:299] Negotiation successful
0806 02:22:03.134822 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":181,"threads_started":1}
I20260806 02:22:03.137130 25189 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c54d04380e45e0bfa465c4b6f36310" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44217 } }
I20260806 02:22:03.137380 25189 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:22:03.137460 25189 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c54d04380e45e0bfa465c4b6f36310, State: Initialized, Role: FOLLOWER
I20260806 02:22:03.138003 25189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c54d04380e45e0bfa465c4b6f36310" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44217 } }
I20260806 02:22:03.138168 25189 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:22:03.138242 25189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:22:03.138341 25189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:22:03.139083 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:22:03.139348 25189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c54d04380e45e0bfa465c4b6f36310" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44217 } }
I20260806 02:22:03.139693 25189 leader_election.cc:302] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18c54d04380e45e0bfa465c4b6f36310; no voters:
I20260806 02:22:03.140069 25189 leader_election.cc:288] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:22:03.140147 25197 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:22:03.140353 25197 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [term 1 LEADER]: Becoming Leader. State: Replica: 18c54d04380e45e0bfa465c4b6f36310, State: Running, Role: LEADER
I20260806 02:22:03.140676 25197 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c54d04380e45e0bfa465c4b6f36310" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44217 } }
I20260806 02:22:03.141393 25189 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:22:03.141993 25200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18c54d04380e45e0bfa465c4b6f36310. Latest consensus state: current_term: 1 leader_uuid: "18c54d04380e45e0bfa465c4b6f36310" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c54d04380e45e0bfa465c4b6f36310" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44217 } } }
I20260806 02:22:03.142129 25200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:03.142445 25202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18c54d04380e45e0bfa465c4b6f36310" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c54d04380e45e0bfa465c4b6f36310" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 44217 } } }
I20260806 02:22:03.142549 25202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310 [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:03.142885 25215 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:22:03.146215 25215 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:22:03.148841 25192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:03.143905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59557 (local address 127.26.189.190:44217)
0806 02:22:03.144003 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:03.144007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:03.144426 (+ 419us) server_negotiation.cc:407] Connection header received
0806 02:22:03.144666 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:03.144669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:03.144713 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:03.144808 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:03.145142 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:03.145828 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:03.147059 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:03.147306 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:03.147421 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:03.148360 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:03.148364 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:03.148367 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:22:03.148380 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:03.148413 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:22:03.148424 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:03.148524 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:03.148650 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 02:22:03.148685 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 02:22:03.152763 25215 catalog_manager.cc:1347] Generated new cluster ID: 1a04a2a012c7405ca6a68ada399454a6
I20260806 02:22:03.152833 25215 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:22:03.188627 25215 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:22:03.189754 25215 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:22:03.194722 25215 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18c54d04380e45e0bfa465c4b6f36310: Generated new TSK 0
I20260806 02:22:03.195389 25215 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:22:03.202029 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 25096
W20260806 02:22:03.214250 25076 connection.cc:535] client connection to 127.26.189.190:44217 recv error: Network error: failed to read from TLS socket (remote: 127.26.189.190:44217): Connection reset by peer (error 104)
2026-08-06T02:22:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1636 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:22:03 dist-test-slave-gkw7 krb5kdc[25235](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:22:03 dist-test-slave-gkw7 krb5kdc[25235](info): set up 2 sockets
Aug 06 02:22:03 dist-test-slave-gkw7 krb5kdc[25235](info): commencing operation
krb5kdc: starting...
W20260806 02:22:04.436270 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:22:04 dist-test-slave-gkw7 krb5kdc[25235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:22:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:22:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:22:04.569221 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:33507
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:35843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:33507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:22:04.683476 25249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:22:04.683791 25249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:22:04.683874 25249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:22:04.687922 25249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:22:04.688015 25249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:22:04.688055 25249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:22:04.688113 25249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:22:04.688158 25249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:22:04.693475 25249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:35843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:33507
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:33507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:22:04.694552 25249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:22:04.695581 25249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:22:04.704463 25256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:04.704468 25257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:04.704455 25263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:04.704650 25249 server_base.cc:1034] running on GCE node
I20260806 02:22:04.705407 25249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:22:04.706534 25249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:22:04.707736 25249 hybrid_clock.cc:648] HybridClock initialized: now 1785982924707718 us; error 30 us; skew 500 ppm
Aug 06 02:22:04 dist-test-slave-gkw7 krb5kdc[25235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982924, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:22:04.710604 25249 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:22:04.711481 25249 webserver.cc:460] Webserver started at http://127.26.189.190:37047/ using document root <none> and password file <none>
I20260806 02:22:04.712002 25249 fs_manager.cc:359] Metadata directory not provided
I20260806 02:22:04.712061 25249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:22:04.712227 25249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:22:04.714283 25249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "24fb361f58fc44b6a80ac2239128f8b8"
format_stamp: "Formatted at 2026-08-06 02:22:04 on dist-test-slave-gkw7"
server_key: "0912632c52ec13a828ba1077849398a0"
server_key_iv: "ec68921c76026e4a7a372fa31d74e8fc"
server_key_version: "encryptionkey@0"
I20260806 02:22:04.714802 25249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "24fb361f58fc44b6a80ac2239128f8b8"
format_stamp: "Formatted at 2026-08-06 02:22:04 on dist-test-slave-gkw7"
server_key: "0912632c52ec13a828ba1077849398a0"
server_key_iv: "ec68921c76026e4a7a372fa31d74e8fc"
server_key_version: "encryptionkey@0"
I20260806 02:22:04.718395 25249 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:22:04.720698 25270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:22:04.722124 25249 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 02:22:04.722249 25249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "24fb361f58fc44b6a80ac2239128f8b8"
format_stamp: "Formatted at 2026-08-06 02:22:04 on dist-test-slave-gkw7"
server_key: "0912632c52ec13a828ba1077849398a0"
server_key_iv: "ec68921c76026e4a7a372fa31d74e8fc"
server_key_version: "encryptionkey@0"
I20260806 02:22:04.722339 25249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:22:04.726930 25249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:22:04.730223 25249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:22:04.730369 25249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:22:04.737793 25249 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:33507
I20260806 02:22:04.737826 25349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:33507 every 8 connection(s)
I20260806 02:22:04.738725 25249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:22:04.741426 25350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:22:04.746681 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 25249
I20260806 02:22:04.746841 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:22:04.747129 27382 external_mini_cluster.cc:1428] Setting key 2338490678c6398202903a5daeb9b28a
I20260806 02:22:04.747488 25350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8: Bootstrap starting.
I20260806 02:22:04.750059 25350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8: Neither blocks nor log segments found. Creating new log.
I20260806 02:22:04.750887 25350 log.cc:824] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8: Log is configured to *not* fsync() on all Append() calls
I20260806 02:22:04.752437 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:04.748513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44659 (local address 127.26.189.190:33507)
0806 02:22:04.749012 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:04.749027 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:04.749062 (+ 35us) server_negotiation.cc:407] Connection header received
0806 02:22:04.749774 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:04.749792 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:04.750066 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:04.750445 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:04.751235 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:04.751241 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:04.751255 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:22:04.751276 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:04.751336 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:22:04.751357 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:04.751472 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:04.751580 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 02:22:04.751743 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":159,"threads_started":1}
I20260806 02:22:04.752924 25350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8: No bootstrap required, opened a new log
I20260806 02:22:04.755405 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:22:04.756870 25350 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24fb361f58fc44b6a80ac2239128f8b8" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33507 } }
I20260806 02:22:04.757103 25350 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:22:04.757180 25350 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24fb361f58fc44b6a80ac2239128f8b8, State: Initialized, Role: FOLLOWER
I20260806 02:22:04.757687 25350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24fb361f58fc44b6a80ac2239128f8b8" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33507 } }
I20260806 02:22:04.757864 25350 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:22:04.757943 25350 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:22:04.758057 25350 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:22:04.759233 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:04.757522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49889 (local address 127.26.189.190:33507)
0806 02:22:04.757675 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:04.757680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:04.757871 (+ 191us) server_negotiation.cc:407] Connection header received
0806 02:22:04.758028 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:04.758031 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:04.758068 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:04.758150 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:04.758834 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:04.758837 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:04.758840 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:22:04.758851 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:04.758880 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:22:04.758893 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:04.758991 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:04.759033 (+ 42us) server_negotiation.cc:299] Negotiation successful
0806 02:22:04.759068 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 02:22:04.759286 25350 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24fb361f58fc44b6a80ac2239128f8b8" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33507 } }
I20260806 02:22:04.759634 25350 leader_election.cc:302] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24fb361f58fc44b6a80ac2239128f8b8; no voters:
I20260806 02:22:04.759981 25350 leader_election.cc:288] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:22:04.760041 25365 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:22:04.760378 25365 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [term 1 LEADER]: Becoming Leader. State: Replica: 24fb361f58fc44b6a80ac2239128f8b8, State: Running, Role: LEADER
I20260806 02:22:04.760721 25365 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24fb361f58fc44b6a80ac2239128f8b8" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33507 } }
I20260806 02:22:04.761312 25350 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:22:04.762439 25366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24fb361f58fc44b6a80ac2239128f8b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24fb361f58fc44b6a80ac2239128f8b8" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33507 } } }
I20260806 02:22:04.762565 25366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:04.762892 25368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24fb361f58fc44b6a80ac2239128f8b8. Latest consensus state: current_term: 1 leader_uuid: "24fb361f58fc44b6a80ac2239128f8b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24fb361f58fc44b6a80ac2239128f8b8" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33507 } } }
I20260806 02:22:04.762948 25376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:22:04.763057 25368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8 [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:04.765789 25376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:22:04.771366 25376 catalog_manager.cc:1347] Generated new cluster ID: 0b23fe3037bb4ed694319de396fea50a
I20260806 02:22:04.771466 25376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:22:04.785982 25376 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:22:04.786314 25376 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:22:04.790897 25376 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24fb361f58fc44b6a80ac2239128f8b8: Generated new TSK 0
I20260806 02:22:04.791531 25376 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:22:04.800958 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 25249
2026-08-06T02:22:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1599 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:22:04 dist-test-slave-gkw7 krb5kdc[25394](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:22:04 dist-test-slave-gkw7 krb5kdc[25394](info): set up 2 sockets
Aug 06 02:22:04 dist-test-slave-gkw7 krb5kdc[25394](info): commencing operation
krb5kdc: starting...
W20260806 02:22:06.007196 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:22:06 dist-test-slave-gkw7 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:22:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:22:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:22:06.148660 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:40849
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:40849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:22:06.266815 25412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:22:06.267095 25412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:22:06.267138 25412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:22:06.271205 25412 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:22:06.271267 25412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:22:06.271286 25412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:22:06.271304 25412 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:22:06.271371 25412 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:22:06.276894 25412 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:40849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:40849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:22:06.278079 25412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:22:06.279176 25412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:22:06.287990 25421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:06.288012 25417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:06.288012 25419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:06.288504 25412 server_base.cc:1034] running on GCE node
I20260806 02:22:06.289016 25412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:22:06.290187 25412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:22:06.291383 25412 hybrid_clock.cc:648] HybridClock initialized: now 1785982926291369 us; error 29 us; skew 500 ppm
Aug 06 02:22:06 dist-test-slave-gkw7 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:22:06.294512 25412 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:22:06.295440 25412 webserver.cc:460] Webserver started at http://127.26.189.190:43667/ using document root <none> and password file <none>
I20260806 02:22:06.296028 25412 fs_manager.cc:359] Metadata directory not provided
I20260806 02:22:06.296175 25412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:22:06.296413 25412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:22:06.298620 25412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "6ac81907eaf6439d9098a6bb61ed9377"
format_stamp: "Formatted at 2026-08-06 02:22:06 on dist-test-slave-gkw7"
server_key: "395f7480ae469a10d70ce9e77e83836f"
server_key_iv: "d3d64aedd761d148226a9e91f4185cfb"
server_key_version: "encryptionkey@0"
I20260806 02:22:06.299230 25412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "6ac81907eaf6439d9098a6bb61ed9377"
format_stamp: "Formatted at 2026-08-06 02:22:06 on dist-test-slave-gkw7"
server_key: "395f7480ae469a10d70ce9e77e83836f"
server_key_iv: "d3d64aedd761d148226a9e91f4185cfb"
server_key_version: "encryptionkey@0"
I20260806 02:22:06.303180 25412 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260806 02:22:06.305848 25429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:22:06.307159 25412 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 02:22:06.307314 25412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "6ac81907eaf6439d9098a6bb61ed9377"
format_stamp: "Formatted at 2026-08-06 02:22:06 on dist-test-slave-gkw7"
server_key: "395f7480ae469a10d70ce9e77e83836f"
server_key_iv: "d3d64aedd761d148226a9e91f4185cfb"
server_key_version: "encryptionkey@0"
I20260806 02:22:06.307432 25412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:22:06.320544 25412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:22:06.323629 25412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:22:06.323856 25412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:22:06.331504 25412 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:40849
I20260806 02:22:06.331533 25500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:40849 every 8 connection(s)
I20260806 02:22:06.332465 25412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:22:06.335335 25501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:22:06.336576 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 25412
I20260806 02:22:06.336747 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:22:06.337054 27382 external_mini_cluster.cc:1428] Setting key 13755eaa846cb03afd26c3cd54a9a945
I20260806 02:22:06.341513 25501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377: Bootstrap starting.
I20260806 02:22:06.343786 25501 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377: Neither blocks nor log segments found. Creating new log.
I20260806 02:22:06.344646 25501 log.cc:824] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377: Log is configured to *not* fsync() on all Append() calls
Aug 06 02:22:06 dist-test-slave-gkw7 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:22:06.346697 25501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377: No bootstrap required, opened a new log
I20260806 02:22:06.350423 25501 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ac81907eaf6439d9098a6bb61ed9377" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40849 } }
I20260806 02:22:06.350666 25501 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:22:06.350745 25501 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac81907eaf6439d9098a6bb61ed9377, State: Initialized, Role: FOLLOWER
I20260806 02:22:06.351238 25501 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ac81907eaf6439d9098a6bb61ed9377" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40849 } }
I20260806 02:22:06.351292 25505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:06.338546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55961 (local address 127.26.189.190:40849)
0806 02:22:06.338981 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:06.338998 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:06.339033 (+ 35us) server_negotiation.cc:407] Connection header received
0806 02:22:06.339677 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:06.339694 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:06.340022 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:06.340363 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:06.341214 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:06.342325 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:06.343211 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:06.343680 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:06.343851 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:06.346482 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:06.346487 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:06.346500 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:06.346526 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:06.348268 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:06.348709 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:06.348714 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:06.348720 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:06.348834 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:06.349130 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:06.349135 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:06.349136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:06.349575 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:06.349804 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:06.350110 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 02:22:06.350421 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":127,"threads_started":1}
I20260806 02:22:06.351406 25501 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:22:06.351476 25501 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:22:06.351605 25501 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:22:06.352682 25501 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ac81907eaf6439d9098a6bb61ed9377" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40849 } }
I20260806 02:22:06.353016 25501 leader_election.cc:302] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ac81907eaf6439d9098a6bb61ed9377; no voters:
I20260806 02:22:06.353375 25501 leader_election.cc:288] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:22:06.353482 25507 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:22:06.353786 25507 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [term 1 LEADER]: Becoming Leader. State: Replica: 6ac81907eaf6439d9098a6bb61ed9377, State: Running, Role: LEADER
I20260806 02:22:06.354158 25507 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ac81907eaf6439d9098a6bb61ed9377" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40849 } }
I20260806 02:22:06.354590 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:22:06.354699 25501 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:22:06.356035 25510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ac81907eaf6439d9098a6bb61ed9377. Latest consensus state: current_term: 1 leader_uuid: "6ac81907eaf6439d9098a6bb61ed9377" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ac81907eaf6439d9098a6bb61ed9377" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40849 } } }
I20260806 02:22:06.356079 25509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ac81907eaf6439d9098a6bb61ed9377" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ac81907eaf6439d9098a6bb61ed9377" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 40849 } } }
I20260806 02:22:06.356240 25509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:06.356233 25510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377 [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:06.356647 25526 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:22:06.359961 25526 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:22:06.366395 25505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:06.356963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51575 (local address 127.26.189.190:40849)
0806 02:22:06.357061 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:06.357067 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:06.357354 (+ 287us) server_negotiation.cc:407] Connection header received
0806 02:22:06.357578 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:06.357584 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:06.357665 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:06.357772 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:06.358583 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:06.359387 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:06.360540 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:06.360881 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:06.360989 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:06.362779 (+ 1790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:06.362782 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:06.362785 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:06.362810 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:06.364523 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:06.365022 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:06.365025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:06.365027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:06.365119 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:06.365437 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:06.365440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:06.365442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:06.365691 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:06.365820 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:06.366098 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 02:22:06.366244 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 02:22:06.366647 25526 catalog_manager.cc:1347] Generated new cluster ID: dd6f0b87cc97463dab26d158760f0f17
I20260806 02:22:06.366834 25526 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:22:06.381891 25526 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:22:06.382855 25526 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:22:06.392582 25526 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ac81907eaf6439d9098a6bb61ed9377: Generated new TSK 0
I20260806 02:22:06.393491 25526 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:22:06.407419 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 25412
2026-08-06T02:22:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1609 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:22:06 dist-test-slave-gkw7 krb5kdc[25544](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:22:06 dist-test-slave-gkw7 krb5kdc[25544](info): set up 2 sockets
Aug 06 02:22:06 dist-test-slave-gkw7 krb5kdc[25544](info): commencing operation
krb5kdc: starting...
W20260806 02:22:07.687225 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:22:07 dist-test-slave-gkw7 krb5kdc[25544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:22:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:22:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:22:07.820382 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:33255
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:45419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:33255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:22:07.933972 25559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:22:07.934289 25559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:22:07.934383 25559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:22:07.938392 25559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:22:07.938476 25559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:22:07.938513 25559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:22:07.938571 25559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:22:07.938611 25559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:22:07.943954 25559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:45419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:33255
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:33255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:22:07.945070 25559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:22:07.946184 25559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:22:07.955087 25569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:07.955087 25566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:07.955209 25559 server_base.cc:1034] running on GCE node
W20260806 02:22:07.955107 25565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:07.955919 25559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:22:07.957031 25559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:22:07.958212 25559 hybrid_clock.cc:648] HybridClock initialized: now 1785982927958194 us; error 33 us; skew 500 ppm
Aug 06 02:22:07 dist-test-slave-gkw7 krb5kdc[25544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982927, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:22:07.969882 25559 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:22:07.970880 25559 webserver.cc:460] Webserver started at http://127.26.189.190:45717/ using document root <none> and password file <none>
I20260806 02:22:07.971453 25559 fs_manager.cc:359] Metadata directory not provided
I20260806 02:22:07.971515 25559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:22:07.971695 25559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:22:07.973948 25559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "68e26cfbf44347d08762dae504421dcc"
format_stamp: "Formatted at 2026-08-06 02:22:07 on dist-test-slave-gkw7"
server_key: "ab5e49edc9351aac0cedba4cfae8e1da"
server_key_iv: "8a8c1bf9ed8e32bac1139a52fe8e1102"
server_key_version: "encryptionkey@0"
I20260806 02:22:07.974502 25559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "68e26cfbf44347d08762dae504421dcc"
format_stamp: "Formatted at 2026-08-06 02:22:07 on dist-test-slave-gkw7"
server_key: "ab5e49edc9351aac0cedba4cfae8e1da"
server_key_iv: "8a8c1bf9ed8e32bac1139a52fe8e1102"
server_key_version: "encryptionkey@0"
I20260806 02:22:07.978559 25559 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:22:07.981238 25577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:22:07.982666 25559 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:22:07.982785 25559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "68e26cfbf44347d08762dae504421dcc"
format_stamp: "Formatted at 2026-08-06 02:22:07 on dist-test-slave-gkw7"
server_key: "ab5e49edc9351aac0cedba4cfae8e1da"
server_key_iv: "8a8c1bf9ed8e32bac1139a52fe8e1102"
server_key_version: "encryptionkey@0"
I20260806 02:22:07.982883 25559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:22:08.016932 25559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:22:08.020241 25559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:22:08.020416 25559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:22:08.028147 25559 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:33255
I20260806 02:22:08.028184 25651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:33255 every 8 connection(s)
I20260806 02:22:08.029152 25559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:22:08.031937 25652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:22:08.037789 25652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc: Bootstrap starting.
I20260806 02:22:08.038386 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 25559
I20260806 02:22:08.038552 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:22:08.038844 27382 external_mini_cluster.cc:1428] Setting key 817463c7e31f308626c79066d0c2cbf0
I20260806 02:22:08.040784 25652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc: Neither blocks nor log segments found. Creating new log.
I20260806 02:22:08.041616 25652 log.cc:824] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc: Log is configured to *not* fsync() on all Append() calls
I20260806 02:22:08.043687 25652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc: No bootstrap required, opened a new log
I20260806 02:22:08.047484 25652 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e26cfbf44347d08762dae504421dcc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33255 } }
I20260806 02:22:08.047850 25652 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:22:08.047940 25652 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e26cfbf44347d08762dae504421dcc, State: Initialized, Role: FOLLOWER
I20260806 02:22:08.048485 25652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e26cfbf44347d08762dae504421dcc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33255 } }
I20260806 02:22:08.048622 25657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:08.040221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59787 (local address 127.26.189.190:33255)
0806 02:22:08.040705 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:08.040720 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:08.040759 (+ 39us) server_negotiation.cc:407] Connection header received
0806 02:22:08.041508 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:08.041581 (+ 73us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:08.042037 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:08.042416 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:08.042858 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:08.043931 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:08.044893 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:08.045404 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:08.045623 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:08.046561 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:08.046567 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:08.046582 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:22:08.047079 (+ 497us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:08.047144 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:22:08.047170 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:08.047288 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:08.047435 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 02:22:08.047662 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":133,"threads_started":1}
I20260806 02:22:08.048647 25652 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:22:08.048835 25652 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:22:08.048966 25652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:22:08.050164 25652 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e26cfbf44347d08762dae504421dcc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33255 } }
I20260806 02:22:08.050563 25652 leader_election.cc:302] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68e26cfbf44347d08762dae504421dcc; no voters:
I20260806 02:22:08.051007 25652 leader_election.cc:288] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:22:08.051084 25659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:22:08.051297 25659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [term 1 LEADER]: Becoming Leader. State: Replica: 68e26cfbf44347d08762dae504421dcc, State: Running, Role: LEADER
I20260806 02:22:08.051671 25659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e26cfbf44347d08762dae504421dcc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33255 } }
I20260806 02:22:08.051863 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:22:08.052400 25652 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:22:08.053459 25660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68e26cfbf44347d08762dae504421dcc. Latest consensus state: current_term: 1 leader_uuid: "68e26cfbf44347d08762dae504421dcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e26cfbf44347d08762dae504421dcc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33255 } } }
I20260806 02:22:08.053705 25660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:08.054157 25661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68e26cfbf44347d08762dae504421dcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e26cfbf44347d08762dae504421dcc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 33255 } } }
I20260806 02:22:08.054240 25676 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:22:08.054344 25661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:08.057762 25676 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:22:08.060003 25657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:08.055395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46917 (local address 127.26.189.190:33255)
0806 02:22:08.055523 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:08.055528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:08.055846 (+ 318us) server_negotiation.cc:407] Connection header received
0806 02:22:08.056115 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:08.056119 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:08.056174 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:08.056269 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:08.056569 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:08.057104 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:08.058296 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:08.058548 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:08.058669 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:08.059547 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:08.059551 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:08.059554 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:22:08.059567 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:08.059603 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:22:08.059614 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:08.059696 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:08.059804 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 02:22:08.059861 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 02:22:08.063947 25676 catalog_manager.cc:1347] Generated new cluster ID: ae7e1944803b488eb0e9ed350b9695f4
I20260806 02:22:08.064031 25676 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:22:08.087182 25676 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:22:08.088312 25676 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:22:08.092367 25676 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68e26cfbf44347d08762dae504421dcc: Generated new TSK 0
I20260806 02:22:08.093298 25676 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:22:08.105363 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 25559
2026-08-06T02:22:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1698 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:22:08 dist-test-slave-gkw7 krb5kdc[25691](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:22:08 dist-test-slave-gkw7 krb5kdc[25691](info): set up 2 sockets
Aug 06 02:22:08 dist-test-slave-gkw7 krb5kdc[25691](info): commencing operation
krb5kdc: starting...
W20260806 02:22:09.404207 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:22:09 dist-test-slave-gkw7 krb5kdc[25691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:22:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:22:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:22:09.545387 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:41643
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:44153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:41643
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:22:09.661412 25709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:22:09.661779 25709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:22:09.661887 25709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:22:09.665913 25709 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:22:09.666025 25709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:22:09.666064 25709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:22:09.666118 25709 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:22:09.666143 25709 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:22:09.671495 25709 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:44153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:41643
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:41643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25709
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:22:09.672673 25709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:22:09.673801 25709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:22:09.682984 25720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:09.682992 25723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:09.682992 25719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:09.683310 25709 server_base.cc:1034] running on GCE node
I20260806 02:22:09.684005 25709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:22:09.685235 25709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:22:09.686430 25709 hybrid_clock.cc:648] HybridClock initialized: now 1785982929686407 us; error 37 us; skew 500 ppm
Aug 06 02:22:09 dist-test-slave-gkw7 krb5kdc[25691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982929, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:22:09.689303 25709 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:22:09.690357 25709 webserver.cc:460] Webserver started at http://127.26.189.190:40291/ using document root <none> and password file <none>
I20260806 02:22:09.690956 25709 fs_manager.cc:359] Metadata directory not provided
I20260806 02:22:09.691052 25709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:22:09.691298 25709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:22:09.693439 25709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "dc23e37b9c264b93b91fb78c75e6ea08"
format_stamp: "Formatted at 2026-08-06 02:22:09 on dist-test-slave-gkw7"
server_key: "fc4365a2031242153edfa1be126bfb1b"
server_key_iv: "7decd090dbc2b1c631d3c936518cbd0b"
server_key_version: "encryptionkey@0"
I20260806 02:22:09.694116 25709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "dc23e37b9c264b93b91fb78c75e6ea08"
format_stamp: "Formatted at 2026-08-06 02:22:09 on dist-test-slave-gkw7"
server_key: "fc4365a2031242153edfa1be126bfb1b"
server_key_iv: "7decd090dbc2b1c631d3c936518cbd0b"
server_key_version: "encryptionkey@0"
I20260806 02:22:09.698238 25709 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 02:22:09.700834 25733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:22:09.702293 25709 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 02:22:09.702445 25709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "dc23e37b9c264b93b91fb78c75e6ea08"
format_stamp: "Formatted at 2026-08-06 02:22:09 on dist-test-slave-gkw7"
server_key: "fc4365a2031242153edfa1be126bfb1b"
server_key_iv: "7decd090dbc2b1c631d3c936518cbd0b"
server_key_version: "encryptionkey@0"
I20260806 02:22:09.702565 25709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:22:09.707440 25709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:22:09.710785 25709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:22:09.710989 25709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:22:09.718176 25709 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:41643
I20260806 02:22:09.718184 25794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:41643 every 8 connection(s)
I20260806 02:22:09.719118 25709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:22:09.722047 25795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:22:09.723369 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 25709
I20260806 02:22:09.723519 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:22:09.723836 27382 external_mini_cluster.cc:1428] Setting key d6694f882938683f14f58b943841d131
I20260806 02:22:09.728740 25795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08: Bootstrap starting.
I20260806 02:22:09.729219 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:09.725216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33605 (local address 127.26.189.190:41643)
0806 02:22:09.725642 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:09.725667 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:09.725703 (+ 36us) server_negotiation.cc:407] Connection header received
0806 02:22:09.726342 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:09.726358 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:09.726637 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:09.726910 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:09.727779 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:09.727784 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:09.727798 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:22:09.727811 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:09.727877 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:22:09.727901 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:09.728093 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:09.728158 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 02:22:09.728374 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":133,"threads_started":1}
I20260806 02:22:09.731335 25795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08: Neither blocks nor log segments found. Creating new log.
I20260806 02:22:09.732201 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:22:09.732213 25795 log.cc:824] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08: Log is configured to *not* fsync() on all Append() calls
I20260806 02:22:09.734283 25795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08: No bootstrap required, opened a new log
I20260806 02:22:09.736189 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:09.734465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60095 (local address 127.26.189.190:41643)
0806 02:22:09.734608 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:09.734613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:09.734862 (+ 249us) server_negotiation.cc:407] Connection header received
0806 02:22:09.734975 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:09.734977 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:09.735006 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:09.735071 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:09.735751 (+ 680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:09.735754 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:09.735756 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 02:22:09.735766 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:09.735790 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 02:22:09.735799 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:09.735867 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:09.735978 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 02:22:09.736009 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 02:22:09.738456 25795 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc23e37b9c264b93b91fb78c75e6ea08" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 41643 } }
I20260806 02:22:09.738695 25795 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 02:22:09.738767 25795 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc23e37b9c264b93b91fb78c75e6ea08, State: Initialized, Role: FOLLOWER
I20260806 02:22:09.739166 25795 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc23e37b9c264b93b91fb78c75e6ea08" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 41643 } }
I20260806 02:22:09.739326 25795 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 02:22:09.739415 25795 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 02:22:09.739514 25795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:22:09.740414 25795 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc23e37b9c264b93b91fb78c75e6ea08" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 41643 } }
I20260806 02:22:09.740793 25795 leader_election.cc:302] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc23e37b9c264b93b91fb78c75e6ea08; no voters:
I20260806 02:22:09.741137 25795 leader_election.cc:288] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 02:22:09.741237 25806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:22:09.741525 25806 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [term 1 LEADER]: Becoming Leader. State: Replica: dc23e37b9c264b93b91fb78c75e6ea08, State: Running, Role: LEADER
I20260806 02:22:09.741927 25806 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc23e37b9c264b93b91fb78c75e6ea08" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 41643 } }
I20260806 02:22:09.742573 25795 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:22:09.743968 25808 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc23e37b9c264b93b91fb78c75e6ea08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc23e37b9c264b93b91fb78c75e6ea08" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 41643 } } }
I20260806 02:22:09.743983 25809 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc23e37b9c264b93b91fb78c75e6ea08. Latest consensus state: current_term: 1 leader_uuid: "dc23e37b9c264b93b91fb78c75e6ea08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc23e37b9c264b93b91fb78c75e6ea08" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 41643 } } }
I20260806 02:22:09.744150 25808 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:09.744170 25809 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08 [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:09.745024 25822 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:22:09.748064 25822 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:22:09.753793 25822 catalog_manager.cc:1347] Generated new cluster ID: 477f952edc794aeab0586b498d3a4694
I20260806 02:22:09.753866 25822 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:22:09.783463 25822 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:22:09.783860 25822 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:22:09.798949 25822 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc23e37b9c264b93b91fb78c75e6ea08: Generated new TSK 0
I20260806 02:22:09.799851 25822 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 02:22:09.810711 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 25709
2026-08-06T02:22:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1704 ms)
[----------] 18 tests from AuthTokenIssuingTest (29524 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:22:09 dist-test-slave-gkw7 krb5kdc[25840](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:22:09 dist-test-slave-gkw7 krb5kdc[25840](info): set up 2 sockets
Aug 06 02:22:09 dist-test-slave-gkw7 krb5kdc[25840](info): commencing operation
krb5kdc: starting...
W20260806 02:22:11.045957 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:22:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:22:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:22:11.181058 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:45771
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:45771,127.26.189.189:44255,127.26.189.188:35499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:22:11.303323 25858 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 02:22:11.303619 25858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:22:11.303680 25858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:22:11.303766 25858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:22:11.307986 25858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:22:11.308063 25858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:22:11.308085 25858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:22:11.308149 25858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:22:11.308182 25858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:22:11.313796 25858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:45771,127.26.189.189:44255,127.26.189.188:35499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:45771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:22:11.314968 25858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:22:11.316109 25858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:22:11.325809 25866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:11.325848 25869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:11.325917 25858 server_base.cc:1034] running on GCE node
W20260806 02:22:11.325873 25871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:11.326634 25858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:22:11.327754 25858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:22:11.328954 25858 hybrid_clock.cc:648] HybridClock initialized: now 1785982931328894 us; error 53 us; skew 500 ppm
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:22:11.332515 25858 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:22:11.333395 25858 webserver.cc:460] Webserver started at http://127.26.189.190:42569/ using document root <none> and password file <none>
I20260806 02:22:11.334002 25858 fs_manager.cc:359] Metadata directory not provided
I20260806 02:22:11.334066 25858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:22:11.334254 25858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:22:11.336349 25858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "59909ab59cd14b69895e7aefeb6197cb"
format_stamp: "Formatted at 2026-08-06 02:22:11 on dist-test-slave-gkw7"
server_key: "199a37fb33bb055f3148487a6ea52c95"
server_key_iv: "cac22cac6ead05c61f229127ee43b194"
server_key_version: "encryptionkey@0"
I20260806 02:22:11.336874 25858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "59909ab59cd14b69895e7aefeb6197cb"
format_stamp: "Formatted at 2026-08-06 02:22:11 on dist-test-slave-gkw7"
server_key: "199a37fb33bb055f3148487a6ea52c95"
server_key_iv: "cac22cac6ead05c61f229127ee43b194"
server_key_version: "encryptionkey@0"
I20260806 02:22:11.340828 25858 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:22:11.343536 25879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:22:11.344794 25858 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 02:22:11.344938 25858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "59909ab59cd14b69895e7aefeb6197cb"
format_stamp: "Formatted at 2026-08-06 02:22:11 on dist-test-slave-gkw7"
server_key: "199a37fb33bb055f3148487a6ea52c95"
server_key_iv: "cac22cac6ead05c61f229127ee43b194"
server_key_version: "encryptionkey@0"
I20260806 02:22:11.345055 25858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:22:11.367076 25858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:22:11.371155 25858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:22:11.371409 25858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:22:11.379493 25858 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:45771
I20260806 02:22:11.379813 25945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:45771 every 8 connection(s)
I20260806 02:22:11.380664 25858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:22:11.383589 25946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:22:11.387548 25946 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:11.388996 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 25858
I20260806 02:22:11.389155 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:22:11.389431 27382 external_mini_cluster.cc:1428] Setting key 33b01dd119912f751b626250448f06bf
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.189.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.189@KRBTEST.COM" created.
I20260806 02:22:11.404857 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.390002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48746 (local address 127.26.189.190:45771)
0806 02:22:11.390595 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.390609 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.390659 (+ 50us) server_negotiation.cc:407] Connection header received
0806 02:22:11.391791 (+ 1132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.391796 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.391976 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.392139 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.393326 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.394293 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.395997 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.396579 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.396704 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.399630 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.399635 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.399646 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.399668 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.401622 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.402133 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.402139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.402140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.402253 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.402589 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.402592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.402594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.402988 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.403137 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.403514 (+ 377us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.403778 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":456,"thread_start_us":162,"threads_started":1}
I20260806 02:22:11.404857 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.390002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:45771 (local address 127.0.0.1:48746)
0806 02:22:11.390489 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.390543 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:11.391402 (+ 859us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:11.392198 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:11.392205 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:11.392716 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:11.393130 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.393153 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.394433 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.394439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.395837 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.395853 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.396754 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.396758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.396900 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.397568 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:11.397596 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:11.399452 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:11.401724 (+ 2272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.401733 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.401742 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.402005 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.402358 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.402364 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.402368 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.402482 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.403106 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:11.403113 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:11.403254 (+ 141us) client_negotiation.cc:769] Sending connection context
0806 02:22:11.403437 (+ 183us) client_negotiation.cc:240] Negotiation successful
0806 02:22:11.403839 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":114,"thread_start_us":132,"threads_started":1}
I20260806 02:22:11.407682 25946 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:11.408535 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.408246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:44255 (local address 127.0.0.1:56964)
0806 02:22:11.408379 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.408467 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 02:22:11.408759 25881 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.189.189:44255: connect: Connection refused (error 111)
I20260806 02:22:11.409999 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.409515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:44255 (local address 127.0.0.1:56974)
0806 02:22:11.409885 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.409943 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":297}
W20260806 02:22:11.410274 25946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.189:44255: Network error: Client connection negotiation failed: client connection to 127.26.189.189:44255: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.189.keytab.
Entry for principal kudu/127.26.189.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.189.keytab.
I20260806 02:22:11.420806 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.189:44255
--webserver_interface=127.26.189.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.189.keytab
--principal=kudu/127.26.189.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:45771,127.26.189.189:44255,127.26.189.188:35499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:22:11.459522 25946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } attempt: 1
I20260806 02:22:11.460456 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.460125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:44255 (local address 127.0.0.1:56984)
0806 02:22:11.460300 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.460372 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 02:22:11.461335 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.461089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:44255 (local address 127.0.0.1:56994)
0806 02:22:11.461207 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.461260 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 02:22:11.461565 25946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.189:44255: Network error: Client connection negotiation failed: client connection to 127.26.189.189:44255: connect: Connection refused (error 111)
I20260806 02:22:11.529775 25946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } attempt: 2
I20260806 02:22:11.530696 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.530379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:44255 (local address 127.0.0.1:57002)
0806 02:22:11.530547 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.530617 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 02:22:11.531473 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.531247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:44255 (local address 127.0.0.1:57006)
0806 02:22:11.531373 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.531421 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260806 02:22:11.531648 25946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.189:44255: Network error: Client connection negotiation failed: client connection to 127.26.189.189:44255: connect: Connection refused (error 111)
W20260806 02:22:11.538655 25954 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 02:22:11.538923 25954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:22:11.538995 25954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:22:11.539077 25954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:22:11.543126 25954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:22:11.543180 25954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:22:11.543200 25954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:22:11.543246 25954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:22:11.543280 25954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:22:11.548626 25954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:45771,127.26.189.189:44255,127.26.189.188:35499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.189.keytab
--principal=kudu/127.26.189.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.189:44255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.189.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:22:11.549816 25954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:22:11.550922 25954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:22:11.559948 25961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:11.560153 25954 server_base.cc:1034] running on GCE node
W20260806 02:22:11.560390 25965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:11.560395 25962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:11.561070 25954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:22:11.562305 25954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:22:11.563501 25954 hybrid_clock.cc:648] HybridClock initialized: now 1785982931563489 us; error 26 us; skew 500 ppm
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:22:11.566424 25954 init.cc:377] Logged in from keytab as kudu/127.26.189.189@KRBTEST.COM (short username kudu)
I20260806 02:22:11.567394 25954 webserver.cc:460] Webserver started at http://127.26.189.189:38355/ using document root <none> and password file <none>
I20260806 02:22:11.567975 25954 fs_manager.cc:359] Metadata directory not provided
I20260806 02:22:11.568073 25954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:22:11.568321 25954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:22:11.570487 25954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/data/instance:
uuid: "c1843e4b74864d8a9c36fc0db5437b47"
format_stamp: "Formatted at 2026-08-06 02:22:11 on dist-test-slave-gkw7"
server_key: "0bcf08651b7b80fadb67c335c05c6330"
server_key_iv: "232ef002697db2dea8115b725af5b046"
server_key_version: "encryptionkey@0"
I20260806 02:22:11.571079 25954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/wal/instance:
uuid: "c1843e4b74864d8a9c36fc0db5437b47"
format_stamp: "Formatted at 2026-08-06 02:22:11 on dist-test-slave-gkw7"
server_key: "0bcf08651b7b80fadb67c335c05c6330"
server_key_iv: "232ef002697db2dea8115b725af5b046"
server_key_version: "encryptionkey@0"
I20260806 02:22:11.574827 25954 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 02:22:11.577229 25975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:22:11.578591 25954 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:22:11.578749 25954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/wal
uuid: "c1843e4b74864d8a9c36fc0db5437b47"
format_stamp: "Formatted at 2026-08-06 02:22:11 on dist-test-slave-gkw7"
server_key: "0bcf08651b7b80fadb67c335c05c6330"
server_key_iv: "232ef002697db2dea8115b725af5b046"
server_key_version: "encryptionkey@0"
I20260806 02:22:11.578867 25954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:22:11.594022 25954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:22:11.597397 25954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:22:11.597690 25954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:22:11.604874 25954 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.189:44255
I20260806 02:22:11.605165 26039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.189:44255 every 8 connection(s)
I20260806 02:22:11.605939 25954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
I20260806 02:22:11.608084 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 25954
I20260806 02:22:11.608217 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-1/wal/instance
I20260806 02:22:11.608542 27382 external_mini_cluster.cc:1428] Setting key 21e5224f3151aad0f14de91fea76491a
I20260806 02:22:11.609223 26040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:22:11.613408 26040 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.189.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.188@KRBTEST.COM" created.
I20260806 02:22:11.622834 25946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } attempt: 3
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.189@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:22:11.629802 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.615480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48756 (local address 127.26.189.190:45771)
0806 02:22:11.615649 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.615655 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.616640 (+ 985us) server_negotiation.cc:407] Connection header received
0806 02:22:11.618111 (+ 1471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.618114 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.618168 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.618246 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.619499 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.620108 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.621524 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.622002 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.622135 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.625358 (+ 3223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.625362 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.625365 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.625392 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.627098 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.627651 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.627656 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.627658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.627755 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.628408 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.628413 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.628415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.628607 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.628722 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.629418 (+ 696us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.629585 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.189@KRBTEST.COM
I20260806 02:22:11.630904 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.615875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:45771 (local address 127.0.0.1:48756)
0806 02:22:11.616434 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.616499 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:11.617881 (+ 1382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:11.618414 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:11.618421 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:11.618855 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:11.619355 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.619368 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.620242 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.620245 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.621388 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.621398 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.622161 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.622163 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.622312 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.623177 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:11.623194 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:11.625206 (+ 2012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:11.627219 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.627225 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.627240 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.627539 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.628127 (+ 588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.628130 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.628131 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.628296 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.628721 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:11.628739 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:11.629079 (+ 340us) client_negotiation.cc:769] Sending connection context
0806 02:22:11.629307 (+ 228us) client_negotiation.cc:240] Negotiation successful
0806 02:22:11.629773 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":118,"threads_started":1}
I20260806 02:22:11.632714 26040 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:11.634879 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.623362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:44255 (local address 127.0.0.1:57016)
0806 02:22:11.623513 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.623529 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:11.623612 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:11.624513 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:11.624516 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:11.624747 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:11.624863 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.624868 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.626096 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.626102 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.626958 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.626969 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.627868 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.627871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.627962 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.628783 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:11.628796 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:11.630931 (+ 2135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:11.633049 (+ 2118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.633055 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.633060 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.633345 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.633756 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.633759 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.633761 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.633851 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.634335 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:11.634338 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:11.634437 (+ 99us) client_negotiation.cc:769] Sending connection context
0806 02:22:11.634562 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 02:22:11.634697 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 02:22:11.634982 26046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.623766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57016 (local address 127.26.189.189:44255)
0806 02:22:11.624092 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.624101 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.624143 (+ 42us) server_negotiation.cc:407] Connection header received
0806 02:22:11.624185 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.624189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.624356 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.624530 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.624979 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.625939 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.627086 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.627735 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.627870 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.631092 (+ 3222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.631101 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.631114 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.631140 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.632919 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.633474 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.633479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.633481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.633665 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.633950 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.633953 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.633954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.634213 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.634370 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.634653 (+ 283us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.634793 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":101,"threads_started":1}
I20260806 02:22:11.637584 25946 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.189@KRBTEST.COM for kudu/127.26.189.189@KRBTEST.COM
I20260806 02:22:11.638396 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.638067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49828)
0806 02:22:11.638227 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.638314 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260806 02:22:11.639364 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.638985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49836)
0806 02:22:11.639200 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.639281 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
W20260806 02:22:11.639499 25946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:35499: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.188.keytab.
Entry for principal kudu/127.26.189.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.188.keytab.
I20260806 02:22:11.641511 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.188:35499
--webserver_interface=127.26.189.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.188.keytab
--principal=kudu/127.26.189.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:45771,127.26.189.189:44255,127.26.189.188:35499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:22:11.642204 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.633312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:44255 (local address 127.0.0.1:57018)
0806 02:22:11.633480 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.633494 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:11.633587 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:11.634112 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:11.634115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:11.634258 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:11.634345 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.634349 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.635168 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.635173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.635840 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.635851 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.636369 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.636373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.636468 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.636984 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:11.636998 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:11.638450 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:11.640446 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.640452 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.640457 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.640727 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.641020 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.641023 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.641025 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.641149 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.641557 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:11.641562 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:11.641667 (+ 105us) client_negotiation.cc:769] Sending connection context
0806 02:22:11.641813 (+ 146us) client_negotiation.cc:240] Negotiation successful
0806 02:22:11.641965 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260806 02:22:11.642949 26047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.633407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57018 (local address 127.26.189.189:44255)
0806 02:22:11.633830 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.633837 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.633849 (+ 12us) server_negotiation.cc:407] Connection header received
0806 02:22:11.633876 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.633879 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.633910 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.634018 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.634454 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.635041 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.635959 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.636264 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.636346 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.638640 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.638643 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.638646 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.638669 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.640340 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.640847 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.640850 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.640851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.640927 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.641252 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.641255 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.641256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.641421 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.641498 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.642529 (+ 1031us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.642666 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":216,"threads_started":1}
I20260806 02:22:11.643676 26040 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:11.644400 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.644102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49840)
0806 02:22:11.644228 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.644322 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 02:22:11.644663 25976 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
I20260806 02:22:11.645663 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.645335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49854)
0806 02:22:11.645476 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.645584 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 02:22:11.645879 26040 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:35499: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
I20260806 02:22:11.670683 25946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } attempt: 1
I20260806 02:22:11.671591 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.671261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49858)
0806 02:22:11.671437 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.671505 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 02:22:11.672375 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.672162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49874)
0806 02:22:11.672261 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.672321 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 02:22:11.672531 25946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:35499: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
I20260806 02:22:11.695155 26040 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } attempt: 1
I20260806 02:22:11.696130 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.695747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49882)
0806 02:22:11.695935 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.696021 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 02:22:11.696954 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.696703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49890)
0806 02:22:11.696829 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.696884 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 02:22:11.697105 26040 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:35499: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
I20260806 02:22:11.747731 25946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } attempt: 2
I20260806 02:22:11.748778 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.748458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49906)
0806 02:22:11.748623 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.748692 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 02:22:11.749621 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.749346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49918)
0806 02:22:11.749442 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.749488 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260806 02:22:11.749778 25946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:35499: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
W20260806 02:22:11.758673 26048 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 02:22:11.758937 26048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:22:11.759009 26048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:22:11.759080 26048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:22:11.763123 26048 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:22:11.763177 26048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:22:11.763197 26048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:22:11.763260 26048 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:22:11.763298 26048 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:22:11.765309 26040 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } attempt: 2
I20260806 02:22:11.766196 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.765860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49930)
0806 02:22:11.766034 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.766105 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 02:22:11.766948 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.766719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49940)
0806 02:22:11.766833 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.766888 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 02:22:11.767099 26040 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:35499: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35499: connect: Connection refused (error 111)
I20260806 02:22:11.769066 26048 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:45771,127.26.189.189:44255,127.26.189.188:35499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.188.keytab
--principal=kudu/127.26.189.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.188:35499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.189.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:22:11.770242 26048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:22:11.771292 26048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:22:11.779888 26060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:11.779911 26048 server_base.cc:1034] running on GCE node
W20260806 02:22:11.779841 26055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:11.779862 26057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:11.780683 26048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:22:11.781998 26048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:22:11.783191 26048 hybrid_clock.cc:648] HybridClock initialized: now 1785982931783154 us; error 47 us; skew 500 ppm
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:22:11.786079 26048 init.cc:377] Logged in from keytab as kudu/127.26.189.188@KRBTEST.COM (short username kudu)
I20260806 02:22:11.787001 26048 webserver.cc:460] Webserver started at http://127.26.189.188:33251/ using document root <none> and password file <none>
I20260806 02:22:11.787595 26048 fs_manager.cc:359] Metadata directory not provided
I20260806 02:22:11.787691 26048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:22:11.787935 26048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:22:11.790199 26048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/data/instance:
uuid: "bb660b1673094c79a9fec5be15de942a"
format_stamp: "Formatted at 2026-08-06 02:22:11 on dist-test-slave-gkw7"
server_key: "27df3cbd9434702b67b7d04e23ebc5a2"
server_key_iv: "f22f789e390935fe17601c1f7b3b0c71"
server_key_version: "encryptionkey@0"
I20260806 02:22:11.790796 26048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/wal/instance:
uuid: "bb660b1673094c79a9fec5be15de942a"
format_stamp: "Formatted at 2026-08-06 02:22:11 on dist-test-slave-gkw7"
server_key: "27df3cbd9434702b67b7d04e23ebc5a2"
server_key_iv: "f22f789e390935fe17601c1f7b3b0c71"
server_key_version: "encryptionkey@0"
I20260806 02:22:11.794693 26048 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 02:22:11.797168 26070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:22:11.798410 26048 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 02:22:11.798556 26048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/wal
uuid: "bb660b1673094c79a9fec5be15de942a"
format_stamp: "Formatted at 2026-08-06 02:22:11 on dist-test-slave-gkw7"
server_key: "27df3cbd9434702b67b7d04e23ebc5a2"
server_key_iv: "f22f789e390935fe17601c1f7b3b0c71"
server_key_version: "encryptionkey@0"
I20260806 02:22:11.798669 26048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:22:11.819126 26048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:22:11.822160 26048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:22:11.822387 26048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:22:11.829442 26048 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.188:35499
I20260806 02:22:11.830003 26136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.188:35499 every 8 connection(s)
I20260806 02:22:11.830581 26048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
I20260806 02:22:11.833397 26137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:22:11.837286 26137 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:11.839970 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 26048
I20260806 02:22:11.840101 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785982634882397-27382-0/minicluster-data/master-2/wal/instance
I20260806 02:22:11.840457 27382 external_mini_cluster.cc:1428] Setting key 0df51697be1e5a014d9dfa6409c1ef88
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.188@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.188@KRBTEST.COM
I20260806 02:22:11.848961 25946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } attempt: 3
I20260806 02:22:11.852772 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.839322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48766 (local address 127.26.189.190:45771)
0806 02:22:11.839475 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.839480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.840445 (+ 965us) server_negotiation.cc:407] Connection header received
0806 02:22:11.841706 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.841710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.841779 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.841891 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.843040 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.843639 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.844830 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.845193 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.845277 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.848137 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.848141 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.848144 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.848172 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.850273 (+ 2101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.850941 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.850945 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.850948 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.851047 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.851442 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.851446 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.851447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.851742 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.851851 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.852467 (+ 616us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.852596 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 02:22:11.854007 26139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.839695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:45771 (local address 127.0.0.1:48766)
0806 02:22:11.840243 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.840310 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:11.841440 (+ 1130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:11.841970 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:11.841977 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:11.842434 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:11.842850 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.842870 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.843759 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.843762 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.844695 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.844703 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.845328 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.845331 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.845637 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.846318 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:11.846333 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:11.847942 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:11.850397 (+ 2455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.850406 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.850417 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.850825 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.851155 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.851158 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.851160 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.851355 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.851863 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:11.851870 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:11.852165 (+ 295us) client_negotiation.cc:769] Sending connection context
0806 02:22:11.852392 (+ 227us) client_negotiation.cc:240] Negotiation successful
0806 02:22:11.852717 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":72,"thread_start_us":125,"threads_started":1}
I20260806 02:22:11.854274 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.841183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49944 (local address 127.26.189.188:35499)
0806 02:22:11.841653 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.841665 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.841706 (+ 41us) server_negotiation.cc:407] Connection header received
0806 02:22:11.841872 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.841879 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.842088 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.842229 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.843122 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.844181 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.845144 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.845756 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.845883 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.848691 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.848699 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.848740 (+ 41us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.848766 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.851516 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.852036 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.852042 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.852044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.852133 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.852472 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.852476 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.852477 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.852762 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.852973 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.853722 (+ 749us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.853850 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":299,"thread_start_us":148,"threads_started":1}
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.188@KRBTEST.COM
I20260806 02:22:11.856367 26137 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:11.858255 26040 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } attempt: 3
I20260806 02:22:11.858839 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.849402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49946)
0806 02:22:11.849625 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.849641 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:11.849731 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:11.850043 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:11.850045 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:11.850285 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:11.850400 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.850407 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.851396 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.851400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.852148 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.852159 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.852762 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.852766 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.852870 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.853374 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:11.853388 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:11.854939 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:11.857143 (+ 2204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.857149 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.857154 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.857403 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.857795 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.857798 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.857800 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.857900 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.858366 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:11.858372 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:11.858470 (+ 98us) client_negotiation.cc:769] Sending connection context
0806 02:22:11.858549 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 02:22:11.858669 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119}
I20260806 02:22:11.859397 26142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.849447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49946 (local address 127.26.189.188:35499)
0806 02:22:11.849782 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.849813 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.849828 (+ 15us) server_negotiation.cc:407] Connection header received
0806 02:22:11.849866 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.849869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.849917 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.850030 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.850526 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.851261 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.852289 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.852623 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.853244 (+ 621us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.855072 (+ 1828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.855076 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.855077 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.855098 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.857033 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.857512 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.857517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.857519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.857646 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.858036 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.858041 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.858045 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.858243 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.859025 (+ 782us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.859108 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.859221 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":137,"threads_started":1}
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.188@KRBTEST.COM for kudu/127.26.189.189@KRBTEST.COM
I20260806 02:22:11.862377 25946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb: Bootstrap starting.
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:22:11.865512 25946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb: Neither blocks nor log segments found. Creating new log.
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.189@KRBTEST.COM for kudu/127.26.189.188@KRBTEST.COM
I20260806 02:22:11.866168 26047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.856999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57034 (local address 127.26.189.189:44255)
0806 02:22:11.857135 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.857140 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.857445 (+ 305us) server_negotiation.cc:407] Connection header received
0806 02:22:11.857571 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.857573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.857628 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.857720 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.858123 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.858838 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.859884 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.860254 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.860329 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.862705 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.862712 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.862718 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.862746 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.864387 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.864892 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.864898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.864903 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.864993 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.865267 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.865270 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.865272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.865444 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.865590 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.865876 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.865999 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 02:22:11.866501 25946 log.cc:824] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb: Log is configured to *not* fsync() on all Append() calls
I20260806 02:22:11.867548 26139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.856875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:44255 (local address 127.0.0.1:57034)
0806 02:22:11.857359 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.857370 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:11.857467 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:11.857742 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:11.857745 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:11.857907 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:11.857999 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.858005 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.858963 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.858969 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.859758 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.859767 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.860467 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.860471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.860578 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.861052 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:11.861066 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:11.862564 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:11.864504 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.864509 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.864511 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.864760 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.865092 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.865094 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.865095 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.865162 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.865570 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:11.865573 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:11.865671 (+ 98us) client_negotiation.cc:769] Sending connection context
0806 02:22:11.867259 (+ 1588us) client_negotiation.cc:240] Negotiation successful
0806 02:22:11.867416 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425}
I20260806 02:22:11.868319 26137 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:11.868965 25946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb: No bootstrap required, opened a new log
I20260806 02:22:11.869789 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.858609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49954)
0806 02:22:11.858838 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.858851 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:11.858927 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:11.859356 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:11.859359 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:11.859540 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:11.859627 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.859633 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.860610 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.860614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.861823 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.861834 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.862499 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.862503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.862588 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.863450 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:11.863469 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:11.865892 (+ 2423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:11.867948 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.867952 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.867954 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.868211 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.868600 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.868605 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.868607 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.868711 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.869251 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:11.869254 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:11.869356 (+ 102us) client_negotiation.cc:769] Sending connection context
0806 02:22:11.869438 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 02:22:11.869615 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161}
I20260806 02:22:11.870428 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.856577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48782 (local address 127.26.189.190:45771)
0806 02:22:11.857033 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.857038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.857204 (+ 166us) server_negotiation.cc:407] Connection header received
0806 02:22:11.857304 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.857308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.857355 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.857437 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.858420 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.859659 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.862381 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.862664 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.862740 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.866192 (+ 3452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.866195 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.866198 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.866221 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.868477 (+ 2256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.868988 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.868991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.868994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.869083 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.869413 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.869416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.869418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.869647 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.869821 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.870171 (+ 350us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.870281 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 02:22:11.870784 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.859049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49954 (local address 127.26.189.188:35499)
0806 02:22:11.859145 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.859149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.859160 (+ 11us) server_negotiation.cc:407] Connection header received
0806 02:22:11.859191 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.859194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.859229 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.859744 (+ 515us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.859821 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.860494 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.861984 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.862359 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.863916 (+ 1557us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.866031 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.866034 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.866037 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.866061 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.867708 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.868335 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.868341 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.868342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.868427 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.868833 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.868838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.868842 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.869117 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.870270 (+ 1153us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.870356 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.870459 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 02:22:11.873621 25946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } }
I20260806 02:22:11.873848 25946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59909ab59cd14b69895e7aefeb6197cb, State: Initialized, Role: FOLLOWER
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.188@KRBTEST.COM for kudu/127.26.189.188@KRBTEST.COM
I20260806 02:22:11.874166 25946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } }
I20260806 02:22:11.874267 26040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47: Bootstrap starting.
I20260806 02:22:11.875612 25946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:22:11.877071 26040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47: Neither blocks nor log segments found. Creating new log.
I20260806 02:22:11.878067 26040 log.cc:824] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47: Log is configured to *not* fsync() on all Append() calls
I20260806 02:22:11.878633 26142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.869097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49958 (local address 127.26.189.188:35499)
0806 02:22:11.869204 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.869210 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.869449 (+ 239us) server_negotiation.cc:407] Connection header received
0806 02:22:11.869475 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.869477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.869512 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.869597 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.870080 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.870824 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.871765 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.872092 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.872194 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.874699 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.874703 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.874705 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.874727 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.876429 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.876851 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.876855 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.876857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.876941 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.877274 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.877277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.877279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.877490 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.877607 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.878319 (+ 712us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.878440 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 02:22:11.879033 26139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.868791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35499 (local address 127.0.0.1:49958)
0806 02:22:11.869291 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:11.869304 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:11.869373 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:11.869686 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:11.869689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:11.869860 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:11.869952 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.869962 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.870953 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.870956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.871620 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:11.871632 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.872294 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.872299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:11.872379 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.872831 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:11.872844 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:11.874545 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:11.876541 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.876543 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.876545 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.876758 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.877031 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:11.877034 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:11.877036 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:11.877110 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:11.877639 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:11.877641 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:11.877725 (+ 84us) client_negotiation.cc:769] Sending connection context
0806 02:22:11.877844 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 02:22:11.877993 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":100,"threads_started":1}
Aug 06 02:22:11 dist-test-slave-gkw7 krb5kdc[25840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.189@KRBTEST.COM
I20260806 02:22:11.880821 26145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } } }
I20260806 02:22:11.880945 26145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [sys.catalog]: This master's current role is: FOLLOWER
W20260806 02:22:11.881737 26160 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:22:11.881884 26160 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:22:11.883167 26137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a: Bootstrap starting.
I20260806 02:22:11.883510 26040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47: No bootstrap required, opened a new log
I20260806 02:22:11.880693 25858 master_runner.cc:186] Error getting master registration for 127.26.189.189:44255: OK, instance_id { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" instance_seqno: 1785982931602902 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 02:22:11.884809 25858 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 02:22:11.885710 26137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a: Neither blocks nor log segments found. Creating new log.
I20260806 02:22:11.887001 26137 log.cc:824] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a: Log is configured to *not* fsync() on all Append() calls
I20260806 02:22:11.887620 26040 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } }
I20260806 02:22:11.887864 26040 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1843e4b74864d8a9c36fc0db5437b47, State: Initialized, Role: FOLLOWER
I20260806 02:22:11.888211 26040 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } }
I20260806 02:22:11.889400 26047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.872249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57036 (local address 127.26.189.189:44255)
0806 02:22:11.872355 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.872360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.873790 (+ 1430us) server_negotiation.cc:407] Connection header received
0806 02:22:11.873970 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.873973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.874023 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.874079 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.874979 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.875807 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.876974 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.877318 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.877392 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.885708 (+ 8316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.885712 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.885715 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.885746 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.887545 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.888113 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.888117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.888118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.888209 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.888529 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.888534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.888535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.888731 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.888950 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.889106 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.889215 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 02:22:11.889700 26040 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:22:11.892781 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:22:11.893203 26164 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } } }
I20260806 02:22:11.893340 26164 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:22:11.894659 25913 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "59909ab59cd14b69895e7aefeb6197cb"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48782
I20260806 02:22:11.894997 25913 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 02:22:11.895120 25913 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [term 0 FOLLOWER]: Advancing to term 1
W20260806 02:22:11.896565 26178 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 02:22:11.896560 25913 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } }
W20260806 02:22:11.896733 26178 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:22:11.897949 26010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "59909ab59cd14b69895e7aefeb6197cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c1843e4b74864d8a9c36fc0db5437b47"
I20260806 02:22:11.898172 26010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:22:11.899281 26010 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59909ab59cd14b69895e7aefeb6197cb in term 1.
I20260806 02:22:11.899693 25881 leader_election.cc:302] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59909ab59cd14b69895e7aefeb6197cb, c1843e4b74864d8a9c36fc0db5437b47; no voters:
I20260806 02:22:11.899771 25913 leader_election.cc:288] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [CANDIDATE]: Term 1 election: Requested vote from peers c1843e4b74864d8a9c36fc0db5437b47 (127.26.189.189:44255), bb660b1673094c79a9fec5be15de942a (127.26.189.188:35499)
I20260806 02:22:11.899994 26145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:22:11.900233 26145 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [term 1 LEADER]: Becoming Leader. State: Replica: 59909ab59cd14b69895e7aefeb6197cb, State: Running, Role: LEADER
I20260806 02:22:11.897449 25954 master_runner.cc:186] Error getting master registration for 127.26.189.188:35499: OK, instance_id { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" instance_seqno: 1785982931827542 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 02:22:11.900593 26145 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } }
I20260806 02:22:11.900696 25954 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 02:22:11.902637 26145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59909ab59cd14b69895e7aefeb6197cb. Latest consensus state: current_term: 1 leader_uuid: "59909ab59cd14b69895e7aefeb6197cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } } }
I20260806 02:22:11.902760 26145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:11.903035 26137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a: No bootstrap required, opened a new log
I20260806 02:22:11.908061 26137 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } }
I20260806 02:22:11.908416 26137 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb660b1673094c79a9fec5be15de942a, State: Initialized, Role: FOLLOWER
I20260806 02:22:11.908843 26137 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } }
I20260806 02:22:11.909863 26188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:22:11.910688 26137 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:22:11.910771 26104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "59909ab59cd14b69895e7aefeb6197cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "bb660b1673094c79a9fec5be15de942a"
I20260806 02:22:11.911027 26104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:22:11.911127 26188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 02:22:11.912784 26104 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59909ab59cd14b69895e7aefeb6197cb in term 1.
I20260806 02:22:11.917189 26192 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } } }
I20260806 02:22:11.917438 26192 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:22:11.922065 26142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.905882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49962 (local address 127.26.189.188:35499)
0806 02:22:11.906012 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.906019 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.908473 (+ 2454us) server_negotiation.cc:407] Connection header received
0806 02:22:11.908776 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.908779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.908834 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.908888 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.913139 (+ 4251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.913902 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.915187 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.915542 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.915649 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.917780 (+ 2131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.917784 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.917787 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.917815 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.919774 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.920318 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.920322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.920324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.920430 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.920836 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.920840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.920842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.921088 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.921225 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.921676 (+ 451us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.921837 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 02:22:11.925902 26104 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [term 1 FOLLOWER]: Refusing update from remote peer 59909ab59cd14b69895e7aefeb6197cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:22:11.926602 26180 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:22:11.927888 26047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.907852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57038 (local address 127.26.189.189:44255)
0806 02:22:11.907978 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.907982 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.915460 (+ 7478us) server_negotiation.cc:407] Connection header received
0806 02:22:11.915698 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.915701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.915765 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.915826 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.917691 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.918572 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.919886 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.920262 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.920347 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.923622 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.923626 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.923629 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.923658 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.925659 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.926297 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.926300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.926302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.926397 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.926736 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.926740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.926742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.926964 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.927110 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.927580 (+ 470us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.927712 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 02:22:11.929039 26209 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:22:11.929117 26209 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:22:11.930361 26192 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59909ab59cd14b69895e7aefeb6197cb. Latest consensus state: current_term: 1 leader_uuid: "59909ab59cd14b69895e7aefeb6197cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } } }
I20260806 02:22:11.930474 26192 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:22:11.931360 26010 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [term 1 FOLLOWER]: Refusing update from remote peer 59909ab59cd14b69895e7aefeb6197cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:22:11.931895 26145 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:22:11.933461 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:11.913738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48788 (local address 127.26.189.190:45771)
0806 02:22:11.913851 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:11.913856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:11.923884 (+ 10028us) server_negotiation.cc:407] Connection header received
0806 02:22:11.924107 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:11.924111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:11.924171 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:11.924240 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:11.925208 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.926011 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.927139 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:11.927485 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:11.927586 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:11.929387 (+ 1801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:11.929391 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:11.929394 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:11.929425 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:11.931324 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.931903 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.931907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.931909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.932017 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:11.932366 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:11.932372 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:11.932374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:11.932625 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:11.932766 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:11.933173 (+ 407us) server_negotiation.cc:299] Negotiation successful
0806 02:22:11.933298 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 02:22:11.935354 26192 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "59909ab59cd14b69895e7aefeb6197cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } } }
I20260806 02:22:11.935467 26192 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:22:11.935730 26164 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59909ab59cd14b69895e7aefeb6197cb. Latest consensus state: current_term: 1 leader_uuid: "59909ab59cd14b69895e7aefeb6197cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } } }
I20260806 02:22:11.935860 26164 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:22:11.936101 26145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "59909ab59cd14b69895e7aefeb6197cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } } }
I20260806 02:22:11.936223 26145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:11.936946 26199 mvcc.cc:205] Tried to move back new op lower bound from 7315386089160560640 to 7315386089069023232. Current Snapshot: MvccSnapshot[applied={T|T < 7315386089160560640}]
I20260806 02:22:11.937731 26180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "59909ab59cd14b69895e7aefeb6197cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } } }
I20260806 02:22:11.937846 26180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:11.938902 26164 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "59909ab59cd14b69895e7aefeb6197cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59909ab59cd14b69895e7aefeb6197cb" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 45771 } } peers { permanent_uuid: "c1843e4b74864d8a9c36fc0db5437b47" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 44255 } } peers { permanent_uuid: "bb660b1673094c79a9fec5be15de942a" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35499 } } }
I20260806 02:22:11.939000 26164 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:22:11.941560 26219 mvcc.cc:205] Tried to move back new op lower bound from 7315386089160560640 to 7315386089069023232. Current Snapshot: MvccSnapshot[applied={T|T < 7315386089160560640}]
I20260806 02:22:11.942469 26188 catalog_manager.cc:1347] Generated new cluster ID: abb6d1c90fcd4968ad3c02a008e9e92a
I20260806 02:22:11.942543 26188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:22:11.943195 26211 mvcc.cc:205] Tried to move back new op lower bound from 7315386089160560640 to 7315386089069023232. Current Snapshot: MvccSnapshot[applied={T|T < 7315386089160560640}]
I20260806 02:22:11.961642 26188 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:22:11.962973 26188 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:22:11.972815 26188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59909ab59cd14b69895e7aefeb6197cb: Generated new TSK 0
I20260806 02:22:11.973708 26188 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 02:22:12.011094 25950 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.008410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48804 (local address 127.26.189.190:45771)
0806 02:22:12.008545 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.008550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.009951 (+ 1401us) server_negotiation.cc:407] Connection header received
0806 02:22:12.010160 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.010163 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.010225 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.010281 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.010944 (+ 663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48804: BlockingRecv error: recv got EOF from 127.0.0.1:48804 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260806 02:22:12.012557 26047 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.009301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57050 (local address 127.26.189.189:44255)
0806 02:22:12.009422 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.009426 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.011600 (+ 2174us) server_negotiation.cc:407] Connection header received
0806 02:22:12.011776 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.011779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.011832 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.011891 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.012430 (+ 539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57050: BlockingRecv error: recv got EOF from 127.0.0.1:57050 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260806 02:22:12.014583 26142 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.013031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49976 (local address 127.26.189.188:35499)
0806 02:22:12.013161 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.013167 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.013705 (+ 538us) server_negotiation.cc:407] Connection header received
0806 02:22:12.013872 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.013875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.013923 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.013972 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.014462 (+ 490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49976: BlockingRecv error: recv got EOF from 127.0.0.1:49976 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260806 02:22:12.019495 26047 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.017917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57052 (local address 127.26.189.189:44255)
0806 02:22:12.018022 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.018026 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.018515 (+ 489us) server_negotiation.cc:407] Connection header received
0806 02:22:12.018744 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.018747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.018825 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.018878 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.019387 (+ 509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57052: BlockingRecv error: recv got EOF from 127.0.0.1:57052 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260806 02:22:12.024572 26047 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.023115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57054 (local address 127.26.189.189:44255)
0806 02:22:12.023225 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.023228 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.023705 (+ 477us) server_negotiation.cc:407] Connection header received
0806 02:22:12.023882 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.023885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.023931 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.023982 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.024475 (+ 493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57054: BlockingRecv error: recv got EOF from 127.0.0.1:57054 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260806 02:22:12.030115 26047 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.028659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57060 (local address 127.26.189.189:44255)
0806 02:22:12.028753 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.028757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.029235 (+ 478us) server_negotiation.cc:407] Connection header received
0806 02:22:12.029416 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.029419 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.029464 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.029513 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.030018 (+ 505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57060: BlockingRecv error: recv got EOF from 127.0.0.1:57060 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260806 02:22:12.037949 26047 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.036300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57072 (local address 127.26.189.189:44255)
0806 02:22:12.036442 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.036446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.036953 (+ 507us) server_negotiation.cc:407] Connection header received
0806 02:22:12.037131 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.037134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.037209 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.037261 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.037836 (+ 575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57072: BlockingRecv error: recv got EOF from 127.0.0.1:57072 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260806 02:22:12.050730 26047 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.048629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57078 (local address 127.26.189.189:44255)
0806 02:22:12.048771 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.048777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.049418 (+ 641us) server_negotiation.cc:407] Connection header received
0806 02:22:12.049728 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.049734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.049798 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.049893 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.050599 (+ 706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57078: BlockingRecv error: recv got EOF from 127.0.0.1:57078 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 02:22:12.071794 26047 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.069821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57086 (local address 127.26.189.189:44255)
0806 02:22:12.069957 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.069962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.070651 (+ 689us) server_negotiation.cc:407] Connection header received
0806 02:22:12.070890 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.070893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.070954 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.071015 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.071663 (+ 648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57086: BlockingRecv error: recv got EOF from 127.0.0.1:57086 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 02:22:12.108158 26047 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.106666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57100 (local address 127.26.189.189:44255)
0806 02:22:12.106827 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.106832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.107075 (+ 243us) server_negotiation.cc:407] Connection header received
0806 02:22:12.107257 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.107261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.107322 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.107420 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.108025 (+ 605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57100: BlockingRecv error: recv got EOF from 127.0.0.1:57100 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260806 02:22:12.175781 26047 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.174458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57104 (local address 127.26.189.189:44255)
0806 02:22:12.174625 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.174630 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.174765 (+ 135us) server_negotiation.cc:407] Connection header received
0806 02:22:12.174949 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.174953 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.175010 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.175108 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.175611 (+ 503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57104: BlockingRecv error: recv got EOF from 127.0.0.1:57104 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260806 02:22:12.307325 26047 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.306024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57106 (local address 127.26.189.189:44255)
0806 02:22:12.306201 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.306206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.306362 (+ 156us) server_negotiation.cc:407] Connection header received
0806 02:22:12.306554 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.306557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.306607 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.306697 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.307208 (+ 511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57106: BlockingRecv error: recv got EOF from 127.0.0.1:57106 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260806 02:22:12.567015 26047 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:12.565930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57116 (local address 127.26.189.189:44255)
0806 02:22:12.566100 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:12.566105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:12.566123 (+ 18us) server_negotiation.cc:407] Connection header received
0806 02:22:12.566238 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:12.566241 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:12.566298 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:12.566393 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:12.566890 (+ 497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57116: BlockingRecv error: recv got EOF from 127.0.0.1:57116 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 02:22:12.898253 26178 catalog_manager.cc:1259] Loaded cluster ID: abb6d1c90fcd4968ad3c02a008e9e92a
I20260806 02:22:12.898348 26178 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47: loading cluster ID for follower catalog manager: success
I20260806 02:22:12.900092 26178 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47: acquiring CA information for follower catalog manager: success
I20260806 02:22:12.901338 26178 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c1843e4b74864d8a9c36fc0db5437b47: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 02:22:12.930562 26209 catalog_manager.cc:1259] Loaded cluster ID: abb6d1c90fcd4968ad3c02a008e9e92a
I20260806 02:22:12.930680 26209 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a: loading cluster ID for follower catalog manager: success
I20260806 02:22:12.932421 26209 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a: acquiring CA information for follower catalog manager: success
I20260806 02:22:12.933722 26209 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bb660b1673094c79a9fec5be15de942a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 02:22:13.085618 26311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:13.081393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57130 (local address 127.26.189.189:44255)
0806 02:22:13.081702 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:13.081705 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:13.081722 (+ 17us) server_negotiation.cc:407] Connection header received
0806 02:22:13.081918 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:13.081921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:13.082054 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:13.082163 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:22:13.082436 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:13.083059 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:13.084020 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:13.084265 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:13.084354 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:13.084683 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:22:13.085145 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:22:13.085241 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:13.085317 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 02:22:13.085369 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":78,"threads_started":1}
I20260806 02:22:13.092886 26318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:13.088790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49992 (local address 127.26.189.188:35499)
0806 02:22:13.089014 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:13.089018 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:13.089032 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:22:13.089182 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:13.089185 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:13.089314 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:13.089417 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:22:13.089677 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:13.090200 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:13.091257 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:13.091535 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:13.091679 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:13.092041 (+ 362us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:22:13.092467 (+ 426us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:22:13.092607 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:13.092653 (+ 46us) server_negotiation.cc:299] Negotiation successful
0806 02:22:13.092709 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":81,"threads_started":1}
I20260806 02:22:13.100582 26311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:13.096247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57138 (local address 127.26.189.189:44255)
0806 02:22:13.096397 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:13.096400 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:13.096568 (+ 168us) server_negotiation.cc:407] Connection header received
0806 02:22:13.096686 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:13.096691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:13.096757 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:13.096832 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:22:13.097339 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:13.097927 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:13.099300 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:13.099615 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:13.099733 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:13.100065 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:22:13.100135 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:22:13.100185 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:13.100359 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 02:22:13.100414 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 02:22:13.100767 26325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:13.096000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48808 (local address 127.26.189.190:45771)
0806 02:22:13.096364 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:13.096369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:13.096385 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:22:13.096609 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:13.096614 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:13.096795 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:13.096992 (+ 197us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:22:13.097257 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:13.098122 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:13.099059 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:13.099353 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:13.099450 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:13.099791 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:22:13.100157 (+ 366us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:22:13.100256 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:13.100400 (+ 144us) server_negotiation.cc:299] Negotiation successful
0806 02:22:13.100462 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":70,"threads_started":1}
I20260806 02:22:13.100875 26318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:13.096045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49996 (local address 127.26.189.188:35499)
0806 02:22:13.096217 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:13.096222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:13.096784 (+ 562us) server_negotiation.cc:407] Connection header received
0806 02:22:13.096908 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:13.096914 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:13.096973 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:13.097038 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:22:13.097256 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:13.098083 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:13.099357 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:13.099713 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:13.099842 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:13.100092 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:22:13.100170 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:22:13.100261 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:13.100677 (+ 416us) server_negotiation.cc:299] Negotiation successful
0806 02:22:13.100733 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 02:22:13.109475 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 25858
I20260806 02:22:13.121203 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 25954
I20260806 02:22:13.128602 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 26048
2026-08-06T02:22:13Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3316 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 02:22:13 dist-test-slave-gkw7 krb5kdc[26331](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 02:22:13 dist-test-slave-gkw7 krb5kdc[26331](info): set up 2 sockets
Aug 06 02:22:13 dist-test-slave-gkw7 krb5kdc[26331](info): commencing operation
krb5kdc: starting...
W20260806 02:22:14.382951 27382 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/test-user.keytab.
Aug 06 02:22:14 dist-test-slave-gkw7 krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T02:22:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T02:22:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.189.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
Entry for principal kudu/127.26.189.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab.
I20260806 02:22:14.517647 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:35125
--webserver_interface=127.26.189.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:35125,127.26.189.189:33751,127.26.189.188:35665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 02:22:14.633200 26345 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 02:22:14.633626 26345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:22:14.633709 26345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:22:14.633803 26345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:22:14.637941 26345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:22:14.638059 26345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:22:14.638095 26345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:22:14.638139 26345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:22:14.638175 26345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:22:14.644383 26345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:35125,127.26.189.189:33751,127.26.189.188:35665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.190.keytab
--principal=kudu/127.26.189.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.190:35125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.189.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:22:14.645632 26345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:22:14.646752 26345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:22:14.655757 26350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:14.655750 26351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:14.655750 26355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:14.655905 26345 server_base.cc:1034] running on GCE node
I20260806 02:22:14.656819 26345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:22:14.658082 26345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:22:14.659281 26345 hybrid_clock.cc:648] HybridClock initialized: now 1785982934659246 us; error 58 us; skew 500 ppm
Aug 06 02:22:14 dist-test-slave-gkw7 krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982934, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:22:14.662220 26345 init.cc:377] Logged in from keytab as kudu/127.26.189.190@KRBTEST.COM (short username kudu)
I20260806 02:22:14.663146 26345 webserver.cc:460] Webserver started at http://127.26.189.190:35171/ using document root <none> and password file <none>
I20260806 02:22:14.663688 26345 fs_manager.cc:359] Metadata directory not provided
I20260806 02:22:14.663749 26345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:22:14.663925 26345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:22:14.666071 26345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/data/instance:
uuid: "e0214fb519ee4a7a9d6f66172853c7cc"
format_stamp: "Formatted at 2026-08-06 02:22:14 on dist-test-slave-gkw7"
server_key: "372f3237161928fdb3cc178782095691"
server_key_iv: "e3796722fedb72f0f9f68588f0f29e06"
server_key_version: "encryptionkey@0"
I20260806 02:22:14.666613 26345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/wal/instance:
uuid: "e0214fb519ee4a7a9d6f66172853c7cc"
format_stamp: "Formatted at 2026-08-06 02:22:14 on dist-test-slave-gkw7"
server_key: "372f3237161928fdb3cc178782095691"
server_key_iv: "e3796722fedb72f0f9f68588f0f29e06"
server_key_version: "encryptionkey@0"
I20260806 02:22:14.670449 26345 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 02:22:14.672998 26364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:22:14.674322 26345 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:22:14.674427 26345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/wal
uuid: "e0214fb519ee4a7a9d6f66172853c7cc"
format_stamp: "Formatted at 2026-08-06 02:22:14 on dist-test-slave-gkw7"
server_key: "372f3237161928fdb3cc178782095691"
server_key_iv: "e3796722fedb72f0f9f68588f0f29e06"
server_key_version: "encryptionkey@0"
I20260806 02:22:14.674512 26345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:22:14.688097 26345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:22:14.691596 26345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:22:14.691823 26345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:22:14.699452 26345 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.190:35125
I20260806 02:22:14.699771 26437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.190:35125 every 8 connection(s)
I20260806 02:22:14.700487 26345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/data/info.pb
I20260806 02:22:14.703502 26438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:22:14.705340 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 26345
I20260806 02:22:14.705494 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-0/wal/instance
I20260806 02:22:14.705816 27382 external_mini_cluster.cc:1428] Setting key 1d05181d3c3302d799e63dada8237cbb
I20260806 02:22:14.707789 26438 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.189.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.189@KRBTEST.COM" created.
Aug 06 02:22:14 dist-test-slave-gkw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982934, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:22:14.724498 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.710444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:35125 (local address 127.0.0.1:50676)
0806 02:22:14.711102 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.711150 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:14.712129 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:14.712880 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:14.712885 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:14.713364 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:14.713682 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:14.713699 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.714876 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.714880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:14.715930 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:14.715945 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.716620 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.716624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:14.716737 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:14.717386 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:14.717412 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:14.719117 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:14.721243 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:14.721253 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:14.721263 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:14.721494 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:14.721889 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:14.721894 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:14.721896 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:14.722017 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:14.722638 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:14.722644 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:14.722794 (+ 150us) client_negotiation.cc:769] Sending connection context
0806 02:22:14.722964 (+ 170us) client_negotiation.cc:240] Negotiation successful
0806 02:22:14.723435 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":166,"thread_start_us":166,"threads_started":1}
I20260806 02:22:14.724498 26444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.711560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50676 (local address 127.26.189.190:35125)
0806 02:22:14.711909 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:14.711920 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:14.711967 (+ 47us) server_negotiation.cc:407] Connection header received
0806 02:22:14.712457 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:14.712461 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:14.712658 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:14.712880 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:14.713835 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.714739 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.716069 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.716458 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.716635 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:14.719267 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:14.719274 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:14.719295 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:14.719316 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:14.721122 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:14.721652 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:14.721664 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:14.721665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:14.721775 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:14.722119 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:14.722122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:14.722124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:14.722512 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:14.722656 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:14.723052 (+ 396us) server_negotiation.cc:299] Negotiation successful
0806 02:22:14.723384 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":241,"thread_start_us":109,"threads_started":1}
I20260806 02:22:14.727788 26438 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:14.728638 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.728320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:33751 (local address 127.0.0.1:42566)
0806 02:22:14.728467 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.728540 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:33751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 02:22:14.728873 26370 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.189.189:33751: connect: Connection refused (error 111)
I20260806 02:22:14.729804 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.729591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:33751 (local address 127.0.0.1:42582)
0806 02:22:14.729709 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.729753 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:33751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 02:22:14.729950 26438 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.189:33751: Network error: Client connection negotiation failed: client connection to 127.26.189.189:33751: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.189.keytab.
Entry for principal kudu/127.26.189.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.189.keytab.
I20260806 02:22:14.736860 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.189:33751
--webserver_interface=127.26.189.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.189.keytab
--principal=kudu/127.26.189.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:35125,127.26.189.189:33751,127.26.189.188:35665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:22:14.779227 26438 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } attempt: 1
I20260806 02:22:14.780130 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.779818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:33751 (local address 127.0.0.1:42586)
0806 02:22:14.779972 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.780046 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:33751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 02:22:14.780997 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.780735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:33751 (local address 127.0.0.1:42602)
0806 02:22:14.780861 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.780924 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:33751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 02:22:14.781147 26438 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.189:33751: Network error: Client connection negotiation failed: client connection to 127.26.189.189:33751: connect: Connection refused (error 111)
I20260806 02:22:14.849390 26438 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } attempt: 2
I20260806 02:22:14.850395 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.850025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:33751 (local address 127.0.0.1:42612)
0806 02:22:14.850220 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.850297 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:33751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260806 02:22:14.851225 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.850981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:33751 (local address 127.0.0.1:42622)
0806 02:22:14.851099 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.851159 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.189:33751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 02:22:14.851405 26438 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.189:33751: Network error: Client connection negotiation failed: client connection to 127.26.189.189:33751: connect: Connection refused (error 111)
W20260806 02:22:14.857139 26447 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 02:22:14.857487 26447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:22:14.857573 26447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:22:14.857681 26447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 02:22:14.861763 26447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:22:14.861853 26447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:22:14.861899 26447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:22:14.861954 26447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:22:14.861992 26447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:22:14.867497 26447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:35125,127.26.189.189:33751,127.26.189.188:35665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.189.keytab
--principal=kudu/127.26.189.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.189:33751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.189.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:22:14.868654 26447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:22:14.869798 26447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:22:14.878580 26453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:14.878562 26455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:14.878562 26452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:14.878870 26447 server_base.cc:1034] running on GCE node
I20260806 02:22:14.879515 26447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:22:14.880652 26447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:22:14.881824 26447 hybrid_clock.cc:648] HybridClock initialized: now 1785982934881804 us; error 31 us; skew 500 ppm
Aug 06 02:22:14 dist-test-slave-gkw7 krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982934, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:22:14.884692 26447 init.cc:377] Logged in from keytab as kudu/127.26.189.189@KRBTEST.COM (short username kudu)
I20260806 02:22:14.885677 26447 webserver.cc:460] Webserver started at http://127.26.189.189:38369/ using document root <none> and password file <none>
I20260806 02:22:14.886260 26447 fs_manager.cc:359] Metadata directory not provided
I20260806 02:22:14.886358 26447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:22:14.886603 26447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:22:14.888758 26447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/data/instance:
uuid: "e6fc0e5d68d64b05b09d353e1a55333e"
format_stamp: "Formatted at 2026-08-06 02:22:14 on dist-test-slave-gkw7"
server_key: "0b87774cf2d99132600dd512b0847781"
server_key_iv: "d184648c9f936829a25d3cde43328973"
server_key_version: "encryptionkey@0"
I20260806 02:22:14.889358 26447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/wal/instance:
uuid: "e6fc0e5d68d64b05b09d353e1a55333e"
format_stamp: "Formatted at 2026-08-06 02:22:14 on dist-test-slave-gkw7"
server_key: "0b87774cf2d99132600dd512b0847781"
server_key_iv: "d184648c9f936829a25d3cde43328973"
server_key_version: "encryptionkey@0"
I20260806 02:22:14.893309 26447 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260806 02:22:14.895993 26465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:22:14.897315 26447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 02:22:14.897465 26447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/wal
uuid: "e6fc0e5d68d64b05b09d353e1a55333e"
format_stamp: "Formatted at 2026-08-06 02:22:14 on dist-test-slave-gkw7"
server_key: "0b87774cf2d99132600dd512b0847781"
server_key_iv: "d184648c9f936829a25d3cde43328973"
server_key_version: "encryptionkey@0"
I20260806 02:22:14.897641 26447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:22:14.910087 26447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:22:14.913468 26447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:22:14.913741 26447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:22:14.921470 26447 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.189:33751
I20260806 02:22:14.921849 26538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.189:33751 every 8 connection(s)
I20260806 02:22:14.922564 26447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/data/info.pb
I20260806 02:22:14.924577 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 26447
I20260806 02:22:14.924718 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-1/wal/instance
I20260806 02:22:14.925040 27382 external_mini_cluster.cc:1428] Setting key 21ad5d66d8f3bb184a27ff389aae5dab
I20260806 02:22:14.925612 26539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:22:14.930265 26539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.189.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.189.188@KRBTEST.COM" created.
Aug 06 02:22:14 dist-test-slave-gkw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982934, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.189@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:22:14.942591 26438 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } attempt: 3
I20260806 02:22:14.947428 26444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.932951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50684 (local address 127.26.189.190:35125)
0806 02:22:14.933130 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:14.933135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:14.934144 (+ 1009us) server_negotiation.cc:407] Connection header received
0806 02:22:14.935223 (+ 1079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:14.935226 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:14.935278 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:14.935367 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:14.936649 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.937221 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.938834 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.939091 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.939187 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:14.942384 (+ 3197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:14.942387 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:14.942389 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:14.942416 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:14.944840 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:14.945486 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:14.945493 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:14.945497 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:14.945642 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:14.946059 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:14.946062 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:14.946064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:14.946309 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:14.946422 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:14.947075 (+ 653us) server_negotiation.cc:299] Negotiation successful
0806 02:22:14.947215 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 02:22:14.948464 26542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.933364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:35125 (local address 127.0.0.1:50684)
0806 02:22:14.933950 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.934007 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:14.934993 (+ 986us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:14.935554 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:14.935561 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:14.935953 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:14.936466 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:14.936480 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.937345 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.937348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:14.938661 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:14.938677 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.939285 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.939293 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:14.939540 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:14.940228 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:14.940247 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:14.942177 (+ 1930us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:14.944961 (+ 2784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:14.944967 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:14.944984 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:14.945355 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:14.945748 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:14.945751 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:14.945754 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:14.945935 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:14.946432 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:14.946438 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:14.946764 (+ 326us) client_negotiation.cc:769] Sending connection context
0806 02:22:14.946962 (+ 198us) client_negotiation.cc:240] Negotiation successful
0806 02:22:14.947308 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":217,"threads_started":1}
Aug 06 02:22:14 dist-test-slave-gkw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982934, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.189@KRBTEST.COM
I20260806 02:22:14.950559 26539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:14.955264 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.943068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:33751 (local address 127.0.0.1:42636)
0806 02:22:14.943286 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.943301 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:14.943379 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:14.944375 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:14.944380 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:14.944735 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:14.944909 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:14.944921 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.946255 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.946259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:14.947049 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:14.947059 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.947793 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.947797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:14.947894 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:14.948385 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:14.948399 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:14.950947 (+ 2548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:14.953276 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:14.953281 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:14.953286 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:14.953491 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:14.953921 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:14.953925 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:14.953927 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:14.954022 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:14.954662 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:14.954665 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:14.954755 (+ 90us) client_negotiation.cc:769] Sending connection context
0806 02:22:14.954909 (+ 154us) client_negotiation.cc:240] Negotiation successful
0806 02:22:14.955131 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260806 02:22:14.955477 26544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.943337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42636 (local address 127.26.189.189:33751)
0806 02:22:14.943861 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:14.943878 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:14.943900 (+ 22us) server_negotiation.cc:407] Connection header received
0806 02:22:14.943937 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:14.943941 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:14.944188 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:14.944363 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:14.945028 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.946138 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.947177 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.947650 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.948099 (+ 449us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:14.951114 (+ 3015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:14.951126 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:14.951139 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:14.951166 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:14.953111 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:14.953669 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:14.953675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:14.953677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:14.953766 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:14.954116 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:14.954129 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:14.954130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:14.954551 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:14.954691 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:14.955059 (+ 368us) server_negotiation.cc:299] Negotiation successful
0806 02:22:14.955285 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":75,"server-negotiator.queue_time_us":405,"thread_start_us":171,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.189.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.188.keytab.
Entry for principal kudu/127.26.189.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.188.keytab.
Aug 06 02:22:14 dist-test-slave-gkw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982934, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.189@KRBTEST.COM for kudu/127.26.189.189@KRBTEST.COM
I20260806 02:22:14.957351 27382 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
/tmp/dist-test-taskHiSG4m/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.188:35665
--webserver_interface=127.26.189.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.188.keytab
--principal=kudu/127.26.189.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.189.148:39717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.189.190:35125,127.26.189.189:33751,127.26.189.188:35665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 02:22:14.958006 26438 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:14.958879 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.958502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60154)
0806 02:22:14.958709 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.958785 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260806 02:22:14.959746 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.959417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60156)
0806 02:22:14.959633 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.959679 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
W20260806 02:22:14.959903 26438 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:35665: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
I20260806 02:22:14.961499 26542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.951144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:33751 (local address 127.0.0.1:42648)
0806 02:22:14.951252 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.951269 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:14.951351 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:14.951786 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:14.951789 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:14.952003 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:14.952155 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:14.952166 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.952980 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.952987 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:14.953778 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:14.953787 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.954362 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.954365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:14.954588 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:14.955049 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:14.955062 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:14.957229 (+ 2167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:14.960084 (+ 2855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:14.960086 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:14.960087 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:14.960264 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:14.960582 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:14.960584 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:14.960585 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:14.960657 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:14.961110 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:14.961112 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:14.961188 (+ 76us) client_negotiation.cc:769] Sending connection context
0806 02:22:14.961290 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 02:22:14.961391 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":108}
I20260806 02:22:14.961845 26545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.951184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42648 (local address 127.26.189.189:33751)
0806 02:22:14.951545 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:14.951552 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:14.951564 (+ 12us) server_negotiation.cc:407] Connection header received
0806 02:22:14.951620 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:14.951624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:14.951673 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:14.951763 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:14.952341 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.952877 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.953893 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:14.954253 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:14.954332 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:14.957380 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:14.957384 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:14.957386 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:14.957436 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:14.959950 (+ 2514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:14.960364 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:14.960369 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:14.960374 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:14.960480 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:14.960747 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:14.960751 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:14.960754 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:14.961006 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:14.961118 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:14.961379 (+ 261us) server_negotiation.cc:299] Negotiation successful
0806 02:22:14.961521 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":290,"thread_start_us":142,"threads_started":1}
I20260806 02:22:14.962453 26539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:14.963239 26542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.962892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60164)
0806 02:22:14.963032 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.963137 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 02:22:14.963471 26472 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
I20260806 02:22:14.964329 26542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.964119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60168)
0806 02:22:14.964232 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.964281 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 02:22:14.964483 26539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:35665: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
I20260806 02:22:14.991110 26438 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } attempt: 1
I20260806 02:22:14.992111 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.991726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60184)
0806 02:22:14.991927 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.992006 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260806 02:22:14.992920 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:14.992673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60190)
0806 02:22:14.992797 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:14.992850 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 02:22:14.993081 26438 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:35665: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
I20260806 02:22:15.013767 26539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } attempt: 1
I20260806 02:22:15.014642 26542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.014342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60192)
0806 02:22:15.014493 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:15.014563 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 02:22:15.015374 26542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.015141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60202)
0806 02:22:15.015281 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:15.015322 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 02:22:15.015507 26539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:35665: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
I20260806 02:22:15.068328 26438 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } attempt: 2
I20260806 02:22:15.069283 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.068951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60204)
0806 02:22:15.069119 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:15.069187 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 02:22:15.070123 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.069898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60214)
0806 02:22:15.070017 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:15.070070 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 02:22:15.070247 26438 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:35665: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
W20260806 02:22:15.080036 26546 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 02:22:15.080372 26546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 02:22:15.080435 26546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 02:22:15.080515 26546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260806 02:22:15.083690 26539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } attempt: 2
I20260806 02:22:15.084676 26542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.084323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60228)
0806 02:22:15.084492 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:15.084591 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260806 02:22:15.084715 26546 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 02:22:15.084827 26546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 02:22:15.084877 26546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 02:22:15.084910 26546 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 02:22:15.084981 26546 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 02:22:15.085597 26542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.085282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60234)
0806 02:22:15.085413 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:15.085475 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 02:22:15.085832 26539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.189.188:35665: Network error: Client connection negotiation failed: client connection to 127.26.189.188:35665: connect: Connection refused (error 111)
I20260806 02:22:15.090679 26546 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.189.148:39717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.189.190:35125,127.26.189.189:33751,127.26.189.188:35665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/krb5kdc/kudu_127.26.189.188.keytab
--principal=kudu/127.26.189.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.189.188:35665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.189.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 01:37:46 UTC on ccycloud.quasar-negaek.root.comops.site
build id 4569534
I20260806 02:22:15.091826 26546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 02:22:15.092924 26546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 02:22:15.102211 26555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 02:22:15.102396 26557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:15.102545 26546 server_base.cc:1034] running on GCE node
W20260806 02:22:15.102211 26554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 02:22:15.103170 26546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 02:22:15.104415 26546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 02:22:15.105616 26546 hybrid_clock.cc:648] HybridClock initialized: now 1785982935105569 us; error 51 us; skew 500 ppm
Aug 06 02:22:15 dist-test-slave-gkw7 krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982935, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 02:22:15.108402 26546 init.cc:377] Logged in from keytab as kudu/127.26.189.188@KRBTEST.COM (short username kudu)
I20260806 02:22:15.109337 26546 webserver.cc:460] Webserver started at http://127.26.189.188:43967/ using document root <none> and password file <none>
I20260806 02:22:15.109997 26546 fs_manager.cc:359] Metadata directory not provided
I20260806 02:22:15.110095 26546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 02:22:15.110347 26546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 02:22:15.112478 26546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/data/instance:
uuid: "e575670fe39f40b08b310345a85ce9b5"
format_stamp: "Formatted at 2026-08-06 02:22:15 on dist-test-slave-gkw7"
server_key: "02613a884b089ac871b9e8979fe3d686"
server_key_iv: "de16048ef1724924553801072e99ce0e"
server_key_version: "encryptionkey@0"
I20260806 02:22:15.113070 26546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/wal/instance:
uuid: "e575670fe39f40b08b310345a85ce9b5"
format_stamp: "Formatted at 2026-08-06 02:22:15 on dist-test-slave-gkw7"
server_key: "02613a884b089ac871b9e8979fe3d686"
server_key_iv: "de16048ef1724924553801072e99ce0e"
server_key_version: "encryptionkey@0"
I20260806 02:22:15.117041 26546 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 02:22:15.119575 26567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 02:22:15.120839 26546 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 02:22:15.120996 26546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/data,/tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/wal
uuid: "e575670fe39f40b08b310345a85ce9b5"
format_stamp: "Formatted at 2026-08-06 02:22:15 on dist-test-slave-gkw7"
server_key: "02613a884b089ac871b9e8979fe3d686"
server_key_iv: "de16048ef1724924553801072e99ce0e"
server_key_version: "encryptionkey@0"
I20260806 02:22:15.121114 26546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 02:22:15.135556 26546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 02:22:15.138546 26546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 02:22:15.138774 26546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 02:22:15.145843 26546 rpc_server.cc:307] RPC server started. Bound to: 127.26.189.188:35665
I20260806 02:22:15.146149 26635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.189.188:35665 every 8 connection(s)
I20260806 02:22:15.146864 26546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/data/info.pb
I20260806 02:22:15.149669 26636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 02:22:15.153373 26636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:15.156926 27382 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu as pid 26546
I20260806 02:22:15.157080 27382 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiSG4m/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785982634882397-27382-0/minicluster-data/master-2/wal/instance
I20260806 02:22:15.157349 27382 external_mini_cluster.cc:1428] Setting key 284b10a26122b0e25b93c2bdb5c9fcac
Aug 06 02:22:15 dist-test-slave-gkw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982935, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.188@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
Aug 06 02:22:15 dist-test-slave-gkw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.188@KRBTEST.COM
I20260806 02:22:15.168107 26444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.155332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50688 (local address 127.26.189.190:35125)
0806 02:22:15.155487 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.155491 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.156349 (+ 858us) server_negotiation.cc:407] Connection header received
0806 02:22:15.157445 (+ 1096us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.157448 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.157510 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.157642 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.159150 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.159667 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.160866 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.161085 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.161167 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.163990 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:15.163996 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:15.164001 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:15.164033 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:15.165733 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.166478 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.166480 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.166482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.166562 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.166963 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.166965 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.166966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.167154 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:15.167273 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:15.167801 (+ 528us) server_negotiation.cc:299] Negotiation successful
0806 02:22:15.167926 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 02:22:15.169073 26639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.155700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.190:35125 (local address 127.0.0.1:50688)
0806 02:22:15.156175 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:15.156219 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:15.157218 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:15.157848 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:15.157856 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:15.158370 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:15.159008 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:15.159028 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.159820 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.159823 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:15.160710 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:15.160751 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.161252 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.161257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:15.161458 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.162189 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:15.162207 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:15.163829 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:15.165851 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:15.165865 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:15.165879 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:15.166367 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:15.166663 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:15.166668 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:15.166670 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:15.166863 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:15.167294 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:15.167301 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:15.167552 (+ 251us) client_negotiation.cc:769] Sending connection context
0806 02:22:15.167753 (+ 201us) client_negotiation.cc:240] Negotiation successful
0806 02:22:15.168070 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":43,"thread_start_us":121,"threads_started":1}
I20260806 02:22:15.169073 26641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.158171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60236 (local address 127.26.189.188:35665)
0806 02:22:15.158537 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.158546 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.158568 (+ 22us) server_negotiation.cc:407] Connection header received
0806 02:22:15.158691 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.158694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.158853 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.158984 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.159773 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.160665 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.161853 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.162340 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.162424 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.165054 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:15.165062 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:15.165075 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:15.165100 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:15.166963 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.167392 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.167398 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.167400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.167487 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.167780 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.167784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.167786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.168026 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:15.168245 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:15.168446 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 02:22:15.168590 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":283,"thread_start_us":105,"threads_started":1}
I20260806 02:22:15.169409 26438 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } attempt: 3
I20260806 02:22:15.170919 26636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 02:22:15 dist-test-slave-gkw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982934, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.190@KRBTEST.COM for kudu/127.26.189.188@KRBTEST.COM
Aug 06 02:22:15 dist-test-slave-gkw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982935, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.188@KRBTEST.COM for kudu/127.26.189.189@KRBTEST.COM
I20260806 02:22:15.176993 26539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } attempt: 3
Aug 06 02:22:15 dist-test-slave-gkw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.190@KRBTEST.COM
I20260806 02:22:15.179363 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.169848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60244)
0806 02:22:15.170020 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:15.170035 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:15.170107 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:15.170402 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:15.170407 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:15.170579 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:15.170675 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:15.170681 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.171603 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.171606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:15.172376 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:15.172389 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.172983 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.172990 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:15.173091 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.173593 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:15.173607 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:15.175175 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:15.177360 (+ 2185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:15.177363 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:15.177368 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:15.177674 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:15.178095 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:15.178099 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:15.178101 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:15.178228 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:15.178750 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:15.178753 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:15.178895 (+ 142us) client_negotiation.cc:769] Sending connection context
0806 02:22:15.178991 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 02:22:15.179140 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"spinlock_wait_cycles":8960}
I20260806 02:22:15.180284 26641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.170094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60244 (local address 127.26.189.188:35665)
0806 02:22:15.170213 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.170217 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.170233 (+ 16us) server_negotiation.cc:407] Connection header received
0806 02:22:15.170260 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.170262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.170294 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.170354 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.170820 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.171462 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.172512 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.172855 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.172954 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.175309 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:15.175314 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:15.175319 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:15.175349 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:15.177241 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.177864 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.177869 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.177876 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.177972 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.178360 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.178366 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.178374 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.178609 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:15.179935 (+ 1326us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:15.180006 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 02:22:15.180114 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 02:22:15.181650 26545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.171650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42662 (local address 127.26.189.189:33751)
0806 02:22:15.171772 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.171776 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.171790 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:22:15.171831 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.171835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.171881 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.171956 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.172508 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.173212 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.174116 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.174366 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.174484 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.177287 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:15.177293 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:15.177295 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:15.177329 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:15.179718 (+ 2389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.180205 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.180209 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.180211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.180312 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.180648 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.180652 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.180654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.180878 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:15.180955 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:15.181328 (+ 373us) server_negotiation.cc:299] Negotiation successful
0806 02:22:15.181464 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":51}
I20260806 02:22:15.181897 26444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.172102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50704 (local address 127.26.189.190:35125)
0806 02:22:15.172198 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.172201 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.172220 (+ 19us) server_negotiation.cc:407] Connection header received
0806 02:22:15.172251 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.172253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.172283 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.172369 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.173072 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.173780 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.175012 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.175256 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.175371 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.178154 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:15.178161 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:15.178167 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:15.178208 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:15.179910 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.180419 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.180422 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.180424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.180509 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.180807 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.180814 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.180818 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.181014 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:15.181206 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:15.181604 (+ 398us) server_negotiation.cc:299] Negotiation successful
0806 02:22:15.181724 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30,"spinlock_wait_cycles":2304}
I20260806 02:22:15.182457 26639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.171516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.189:33751 (local address 127.0.0.1:42662)
0806 02:22:15.171607 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:15.171623 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:15.171699 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:15.172066 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:15.172069 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:15.172232 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:15.172352 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:15.172358 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.173382 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.173386 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:15.173987 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:15.173997 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.174484 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.174488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:15.174591 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.175497 (+ 906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:15.175514 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:15.177100 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:15.179849 (+ 2749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:15.179852 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:15.179854 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:15.180091 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:15.180445 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:15.180448 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:15.180449 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:15.180534 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:15.181026 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:15.181029 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:15.181116 (+ 87us) client_negotiation.cc:769] Sending connection context
0806 02:22:15.182168 (+ 1052us) client_negotiation.cc:240] Negotiation successful
0806 02:22:15.182311 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
Aug 06 02:22:15 dist-test-slave-gkw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982934, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.189@KRBTEST.COM for kudu/127.26.189.188@KRBTEST.COM
I20260806 02:22:15.184309 26438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc: Bootstrap starting.
I20260806 02:22:15.187525 26438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc: Neither blocks nor log segments found. Creating new log.
I20260806 02:22:15.188395 26542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.177431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60250)
0806 02:22:15.177766 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:15.177782 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:15.177864 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:15.178808 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:15.178812 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:15.179031 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:15.179159 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:15.179168 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.180844 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.180847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:15.181637 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:15.181647 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.182357 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.182361 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:15.182462 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.183028 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:15.183042 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:15.184567 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:15.186632 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:15.186636 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:15.186637 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:15.186885 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:15.187221 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:15.187225 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:15.187227 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:15.187325 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:15.187799 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:15.187805 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:15.187926 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 02:22:15.188050 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 02:22:15.188198 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223}
I20260806 02:22:15.188467 26642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.178038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60250 (local address 127.26.189.188:35665)
0806 02:22:15.178486 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.178498 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.178510 (+ 12us) server_negotiation.cc:407] Connection header received
0806 02:22:15.178542 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.178544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.178589 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.179283 (+ 694us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.179454 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.180709 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.181792 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.182209 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.182672 (+ 463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.184706 (+ 2034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:15.184710 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:15.184712 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:15.184737 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:15.186507 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.187022 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.187026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.187027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.187112 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.187443 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.187448 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.187450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.187679 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:15.187789 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:15.188127 (+ 338us) server_negotiation.cc:299] Negotiation successful
0806 02:22:15.188241 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":108,"threads_started":1}
I20260806 02:22:15.188494 26438 log.cc:824] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc: Log is configured to *not* fsync() on all Append() calls
Aug 06 02:22:15 dist-test-slave-gkw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.189.189@KRBTEST.COM
I20260806 02:22:15.189703 26636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } has no permanent_uuid. Determining permanent_uuid...
I20260806 02:22:15.193092 26539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e: Bootstrap starting.
I20260806 02:22:15.193362 26545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.183488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42670 (local address 127.26.189.189:33751)
0806 02:22:15.183583 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.183587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.183650 (+ 63us) server_negotiation.cc:407] Connection header received
0806 02:22:15.183831 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.183835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.183875 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.183969 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.184687 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.185319 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.186227 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.186475 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.186589 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.189465 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:15.189469 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:15.189472 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:15.189498 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:15.191256 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.191744 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.191747 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.191749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.191845 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.192180 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.192184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.192185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.192410 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:15.192560 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:15.192940 (+ 380us) server_negotiation.cc:299] Negotiation successful
0806 02:22:15.193064 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Aug 06 02:22:15 dist-test-slave-gkw7 krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785982935, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.189.188@KRBTEST.COM for kudu/127.26.189.188@KRBTEST.COM
I20260806 02:22:15.196403 26539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e: Neither blocks nor log segments found. Creating new log.
I20260806 02:22:15.197127 27382 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 02:22:15.197194 26539 log.cc:824] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e: Log is configured to *not* fsync() on all Append() calls
I20260806 02:22:15.199059 26639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.190231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.189.188:35665 (local address 127.0.0.1:60262)
0806 02:22:15.190327 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0806 02:22:15.190341 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 02:22:15.190415 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 02:22:15.190962 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 02:22:15.190965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 02:22:15.191131 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0806 02:22:15.191193 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:15.191198 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.191983 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.191986 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:15.192485 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 02:22:15.192493 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.193056 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.193059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 02:22:15.193138 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.193599 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 02:22:15.193613 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 02:22:15.195179 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 02:22:15.197388 (+ 2209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:15.197394 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:15.197398 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:15.197711 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:15.198009 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 02:22:15.198013 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 02:22:15.198015 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 02:22:15.198101 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 02:22:15.198549 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 02:22:15.198552 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 02:22:15.198655 (+ 103us) client_negotiation.cc:769] Sending connection context
0806 02:22:15.198765 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 02:22:15.198896 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260806 02:22:15.199146 26642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.190675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60262 (local address 127.26.189.188:35665)
0806 02:22:15.190790 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.190793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.190803 (+ 10us) server_negotiation.cc:407] Connection header received
0806 02:22:15.190828 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.190830 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.190862 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.190952 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.191313 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.191864 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.192602 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.192865 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.192961 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.195475 (+ 2514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:15.195478 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:15.195480 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:15.195500 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:15.197278 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.197823 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.197826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.197827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.197909 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.198195 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.198199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.198200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.198435 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:15.198542 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:15.198842 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 02:22:15.198967 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 02:22:15.199218 26438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc: No bootstrap required, opened a new log
I20260806 02:22:15.198577 26403 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "e0214fb519ee4a7a9d6f66172853c7cc"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50704
I20260806 02:22:15.200485 26539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e: No bootstrap required, opened a new log
I20260806 02:22:15.202831 26636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5: Bootstrap starting.
I20260806 02:22:15.204689 26539 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } }
I20260806 02:22:15.204932 26539 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6fc0e5d68d64b05b09d353e1a55333e, State: Initialized, Role: FOLLOWER
I20260806 02:22:15.204999 26636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5: Neither blocks nor log segments found. Creating new log.
I20260806 02:22:15.205277 26539 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } }
I20260806 02:22:15.205936 26636 log.cc:824] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5: Log is configured to *not* fsync() on all Append() calls
I20260806 02:22:15.207727 26636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5: No bootstrap required, opened a new log
I20260806 02:22:15.208631 26438 raft_consensus.cc:348] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } }
I20260806 02:22:15.208866 26438 raft_consensus.cc:729] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0214fb519ee4a7a9d6f66172853c7cc, State: Initialized, Role: FOLLOWER
I20260806 02:22:15.209193 26438 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } }
I20260806 02:22:15.209753 26647 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } } }
I20260806 02:22:15.209920 26647 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:22:15.210639 26438 sys_catalog.cc:564] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:22:15.210724 26403 raft_consensus.cc:482] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 02:22:15.210826 26403 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:22:15.211041 26636 raft_consensus.cc:348] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } }
I20260806 02:22:15.211241 26636 raft_consensus.cc:729] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e575670fe39f40b08b310345a85ce9b5, State: Initialized, Role: FOLLOWER
I20260806 02:22:15.211555 26636 consensus_queue.cc:260] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } }
I20260806 02:22:15.212316 26403 raft_consensus.cc:504] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } }
I20260806 02:22:15.212881 26539 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:22:15.212962 26636 sys_catalog.cc:564] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 02:22:15.213429 26654 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } } }
I20260806 02:22:15.213673 26654 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:22:15.213986 26501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e6fc0e5d68d64b05b09d353e1a55333e"
I20260806 02:22:15.214246 26501 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:22:15.215799 26501 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0214fb519ee4a7a9d6f66172853c7cc in term 1.
I20260806 02:22:15.216325 26370 leader_election.cc:302] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0214fb519ee4a7a9d6f66172853c7cc, e6fc0e5d68d64b05b09d353e1a55333e; no voters:
I20260806 02:22:15.216713 26647 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 02:22:15.216954 26647 raft_consensus.cc:686] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [term 1 LEADER]: Becoming Leader. State: Replica: e0214fb519ee4a7a9d6f66172853c7cc, State: Running, Role: LEADER
I20260806 02:22:15.217289 26647 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } }
I20260806 02:22:15.217428 26403 leader_election.cc:288] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [CANDIDATE]: Term 1 election: Requested vote from peers e6fc0e5d68d64b05b09d353e1a55333e (127.26.189.189:33751), e575670fe39f40b08b310345a85ce9b5 (127.26.189.188:35665)
I20260806 02:22:15.219161 26647 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0214fb519ee4a7a9d6f66172853c7cc. Latest consensus state: current_term: 1 leader_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } } }
I20260806 02:22:15.219254 26647 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [sys.catalog]: This master's current role is: LEADER
W20260806 02:22:15.220297 26665 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:22:15.220366 26665 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:22:15.219455 26345 master_runner.cc:186] Error getting master registration for 127.26.189.189:33751: OK, instance_id { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" instance_seqno: 1785982934919372 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 02:22:15.222599 26345 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 02:22:15.218042 26656 sys_catalog.cc:455] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } } }
I20260806 02:22:15.218240 26605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e575670fe39f40b08b310345a85ce9b5"
I20260806 02:22:15.224756 26605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 02:22:15.225185 26702 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 02:22:15.226341 26605 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0214fb519ee4a7a9d6f66172853c7cc in term 1.
I20260806 02:22:15.227144 26702 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260806 02:22:15.227337 26695 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:22:15.227449 26695 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:22:15.227564 26656 sys_catalog.cc:458] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 02:22:15.230406 26697 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 02:22:15.230504 26697 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 02:22:15.232944 26605 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [term 1 FOLLOWER]: Refusing update from remote peer e0214fb519ee4a7a9d6f66172853c7cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:22:15.233008 26501 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [term 1 FOLLOWER]: Refusing update from remote peer e0214fb519ee4a7a9d6f66172853c7cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 02:22:15.233800 26647 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:22:15.233961 26696 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 02:22:15.238059 26654 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0214fb519ee4a7a9d6f66172853c7cc. Latest consensus state: current_term: 1 leader_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } } }
I20260806 02:22:15.238206 26654 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:22:15.241921 26656 sys_catalog.cc:455] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0214fb519ee4a7a9d6f66172853c7cc. Latest consensus state: current_term: 1 leader_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } } }
I20260806 02:22:15.242125 26656 sys_catalog.cc:458] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:22:15.248380 26696 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } } }
I20260806 02:22:15.248524 26696 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:15.248843 26709 mvcc.cc:205] Tried to move back new op lower bound from 7315386102708076544 to 7315386102653931520. Current Snapshot: MvccSnapshot[applied={T|T < 7315386102708076544}]
I20260806 02:22:15.248956 26656 sys_catalog.cc:455] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } } }
I20260806 02:22:15.249073 26656 sys_catalog.cc:458] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:22:15.251209 26444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.233766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50716 (local address 127.26.189.190:35125)
0806 02:22:15.233876 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.233881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.234824 (+ 943us) server_negotiation.cc:407] Connection header received
0806 02:22:15.235021 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.235024 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.235074 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.235126 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.236182 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.236927 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.239586 (+ 2659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.239902 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.239983 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.245080 (+ 5097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:15.245084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:15.245087 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:15.245118 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:15.246866 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.249716 (+ 2850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.249720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.249722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.249826 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.250182 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.250186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.250188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.250440 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:15.250559 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:15.250926 (+ 367us) server_negotiation.cc:299] Negotiation successful
0806 02:22:15.251060 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 02:22:15.252036 26716 mvcc.cc:205] Tried to move back new op lower bound from 7315386102708076544 to 7315386102653931520. Current Snapshot: MvccSnapshot[applied={T|T < 7315386102708076544}]
I20260806 02:22:15.252244 26647 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } } }
I20260806 02:22:15.252375 26647 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc [sys.catalog]: This master's current role is: LEADER
I20260806 02:22:15.254082 26654 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0214fb519ee4a7a9d6f66172853c7cc" member_type: VOTER last_known_addr { host: "127.26.189.190" port: 35125 } } peers { permanent_uuid: "e6fc0e5d68d64b05b09d353e1a55333e" member_type: VOTER last_known_addr { host: "127.26.189.189" port: 33751 } } peers { permanent_uuid: "e575670fe39f40b08b310345a85ce9b5" member_type: VOTER last_known_addr { host: "127.26.189.188" port: 35665 } } }
I20260806 02:22:15.254233 26654 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e [sys.catalog]: This master's current role is: FOLLOWER
I20260806 02:22:15.255088 26714 mvcc.cc:205] Tried to move back new op lower bound from 7315386102708076544 to 7315386102653931520. Current Snapshot: MvccSnapshot[applied={T|T < 7315386102708076544}]
I20260806 02:22:15.257470 26545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.234417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42684 (local address 127.26.189.189:33751)
0806 02:22:15.234537 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.234544 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.238322 (+ 3778us) server_negotiation.cc:407] Connection header received
0806 02:22:15.238505 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.238509 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.238562 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.238612 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.240726 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.241468 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.243949 (+ 2481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.244282 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.244372 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.253787 (+ 9415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:15.253793 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:15.253796 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:15.253831 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:15.255609 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.256042 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.256047 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.256052 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.256157 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.256482 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.256485 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.256487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.256712 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:15.256833 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:15.257187 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 02:22:15.257324 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 02:22:15.259936 26702 catalog_manager.cc:1347] Generated new cluster ID: e877180c6627440aa97345407720db91
I20260806 02:22:15.260007 26702 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 02:22:15.271198 26641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:15.234685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60270 (local address 127.26.189.188:35665)
0806 02:22:15.234809 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.234813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.253839 (+ 19026us) server_negotiation.cc:407] Connection header received
0806 02:22:15.254031 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.254034 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.254085 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.254135 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.254976 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.255788 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.256958 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:15.257303 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:15.257376 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:15.264102 (+ 6726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 02:22:15.264106 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 02:22:15.264109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 02:22:15.264142 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 02:22:15.265936 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.269629 (+ 3693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.269633 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.269635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.269747 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 02:22:15.270137 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 02:22:15.270141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 02:22:15.270142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 02:22:15.270392 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 02:22:15.270510 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:15.270894 (+ 384us) server_negotiation.cc:299] Negotiation successful
0806 02:22:15.271036 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:22:15.271651 26702 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 02:22:15.272969 26702 catalog_manager.cc:1504] Loading token signing keys...
I20260806 02:22:15.292711 26702 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e0214fb519ee4a7a9d6f66172853c7cc: Generated new TSK 0
I20260806 02:22:15.293789 26702 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 02:22:15.330060 26444 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.326661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50718 (local address 127.26.189.190:35125)
0806 02:22:15.326797 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.326802 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.328830 (+ 2028us) server_negotiation.cc:407] Connection header received
0806 02:22:15.329040 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.329044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.329098 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.329157 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.329906 (+ 749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50718: BlockingRecv error: recv got EOF from 127.0.0.1:50718 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260806 02:22:15.331692 26545 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.327180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42686 (local address 127.26.189.189:33751)
0806 02:22:15.327349 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.327355 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.330744 (+ 3389us) server_negotiation.cc:407] Connection header received
0806 02:22:15.330920 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.330923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.330973 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.331023 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.331563 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42686: BlockingRecv error: recv got EOF from 127.0.0.1:42686 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 02:22:15.333212 26641 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.328206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60272 (local address 127.26.189.188:35665)
0806 02:22:15.328333 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.328338 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.332315 (+ 3977us) server_negotiation.cc:407] Connection header received
0806 02:22:15.332492 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.332495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.332544 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.332594 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.333089 (+ 495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60272: BlockingRecv error: recv got EOF from 127.0.0.1:60272 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260806 02:22:15.337762 26545 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.336370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42694 (local address 127.26.189.189:33751)
0806 02:22:15.336494 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.336499 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.336727 (+ 228us) server_negotiation.cc:407] Connection header received
0806 02:22:15.336959 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.336962 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.337044 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.337099 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.337657 (+ 558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42694: BlockingRecv error: recv got EOF from 127.0.0.1:42694 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 02:22:15.343194 26545 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.341687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42704 (local address 127.26.189.189:33751)
0806 02:22:15.341815 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.341820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.342315 (+ 495us) server_negotiation.cc:407] Connection header received
0806 02:22:15.342503 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.342507 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.342557 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.342609 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.343090 (+ 481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42704: BlockingRecv error: recv got EOF from 127.0.0.1:42704 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260806 02:22:15.352519 26545 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.347578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42712 (local address 127.26.189.189:33751)
0806 02:22:15.347679 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.347684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.351523 (+ 3839us) server_negotiation.cc:407] Connection header received
0806 02:22:15.351725 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.351728 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.351783 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.351836 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.352389 (+ 553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42712: BlockingRecv error: recv got EOF from 127.0.0.1:42712 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260806 02:22:15.361001 26545 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.359240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42718 (local address 127.26.189.189:33751)
0806 02:22:15.359408 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.359412 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.359963 (+ 551us) server_negotiation.cc:407] Connection header received
0806 02:22:15.360159 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.360162 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.360219 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.360284 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.360888 (+ 604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42718: BlockingRecv error: recv got EOF from 127.0.0.1:42718 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
W20260806 02:22:15.373052 26545 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.371340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42724 (local address 127.26.189.189:33751)
0806 02:22:15.371457 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.371462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.372056 (+ 594us) server_negotiation.cc:407] Connection header received
0806 02:22:15.372266 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.372282 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.372336 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.372390 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.372936 (+ 546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42724: BlockingRecv error: recv got EOF from 127.0.0.1:42724 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 02:22:15.393605 26545 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.391719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42736 (local address 127.26.189.189:33751)
0806 02:22:15.391852 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.391858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.392499 (+ 641us) server_negotiation.cc:407] Connection header received
0806 02:22:15.392736 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.392740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.392796 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.392851 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.393456 (+ 605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42736: BlockingRecv error: recv got EOF from 127.0.0.1:42736 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 02:22:15.430505 26545 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.428436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42742 (local address 127.26.189.189:33751)
0806 02:22:15.428572 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.428578 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.429281 (+ 703us) server_negotiation.cc:407] Connection header received
0806 02:22:15.429561 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.429565 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.429632 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.429696 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.430366 (+ 670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42742: BlockingRecv error: recv got EOF from 127.0.0.1:42742 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260806 02:22:15.498476 26545 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.497271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42752 (local address 127.26.189.189:33751)
0806 02:22:15.497460 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.497463 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.497591 (+ 128us) server_negotiation.cc:407] Connection header received
0806 02:22:15.497794 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.497797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.497849 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.497936 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.498372 (+ 436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42752: BlockingRecv error: recv got EOF from 127.0.0.1:42752 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
W20260806 02:22:15.630081 26545 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.628725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42764 (local address 127.26.189.189:33751)
0806 02:22:15.628887 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.628893 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.629058 (+ 165us) server_negotiation.cc:407] Connection header received
0806 02:22:15.629169 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.629172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.629225 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.629314 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.629947 (+ 633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42764: BlockingRecv error: recv got EOF from 127.0.0.1:42764 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260806 02:22:15.889504 26545 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 02:22:15.888383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42770 (local address 127.26.189.189:33751)
0806 02:22:15.888524 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:15.888528 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:15.888594 (+ 66us) server_negotiation.cc:407] Connection header received
0806 02:22:15.888722 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:15.888725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:15.888776 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:15.888852 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 02:22:15.889343 (+ 491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42770: BlockingRecv error: recv got EOF from 127.0.0.1:42770 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 02:22:16.228878 26695 catalog_manager.cc:1259] Loaded cluster ID: e877180c6627440aa97345407720db91
I20260806 02:22:16.228968 26695 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5: loading cluster ID for follower catalog manager: success
I20260806 02:22:16.230711 26695 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5: acquiring CA information for follower catalog manager: success
I20260806 02:22:16.231669 26697 catalog_manager.cc:1259] Loaded cluster ID: e877180c6627440aa97345407720db91
I20260806 02:22:16.231760 26697 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e: loading cluster ID for follower catalog manager: success
I20260806 02:22:16.231976 26695 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e575670fe39f40b08b310345a85ce9b5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 02:22:16.233322 26697 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e: acquiring CA information for follower catalog manager: success
I20260806 02:22:16.234402 26697 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e6fc0e5d68d64b05b09d353e1a55333e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 02:22:16.407923 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:16.403680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39522 (local address 127.26.189.189:33751)
0806 02:22:16.403984 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:16.403988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:16.404005 (+ 17us) server_negotiation.cc:407] Connection header received
0806 02:22:16.404143 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:16.404147 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:16.404282 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:16.404389 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:22:16.404622 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:16.405166 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:16.406151 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:16.406505 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:16.406638 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:16.406992 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:22:16.407484 (+ 492us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:22:16.407630 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:16.407697 (+ 67us) server_negotiation.cc:299] Negotiation successful
0806 02:22:16.407759 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":84,"threads_started":1}
I20260806 02:22:16.415499 26825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:16.411173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52164 (local address 127.26.189.188:35665)
0806 02:22:16.411455 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:16.411459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:16.411473 (+ 14us) server_negotiation.cc:407] Connection header received
0806 02:22:16.411555 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:16.411558 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:16.411792 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:16.411896 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:22:16.412179 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:16.412725 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:16.413687 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:16.413912 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:16.414001 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:16.414378 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:22:16.414906 (+ 528us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:22:16.415015 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:16.415197 (+ 182us) server_negotiation.cc:299] Negotiation successful
0806 02:22:16.415273 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":117,"threads_started":1}
I20260806 02:22:16.423266 26825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:16.419260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52178 (local address 127.26.189.188:35665)
0806 02:22:16.419390 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:16.419397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:16.419552 (+ 155us) server_negotiation.cc:407] Connection header received
0806 02:22:16.419697 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:16.419703 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:16.419752 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:16.419816 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:22:16.420165 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:16.420899 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:16.421859 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:16.422154 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:16.422251 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:16.422521 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:22:16.422620 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:22:16.422690 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:16.423066 (+ 376us) server_negotiation.cc:299] Negotiation successful
0806 02:22:16.423131 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 02:22:16.423310 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:16.418701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39526 (local address 127.26.189.189:33751)
0806 02:22:16.418810 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:16.418814 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:16.419410 (+ 596us) server_negotiation.cc:407] Connection header received
0806 02:22:16.419653 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:16.419657 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:16.419716 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:16.419801 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:22:16.420106 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:16.420643 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:16.422096 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:16.422412 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:16.422495 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:16.422854 (+ 359us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:22:16.422941 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:22:16.423015 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:16.423144 (+ 129us) server_negotiation.cc:299] Negotiation successful
0806 02:22:16.423198 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 02:22:16.423849 26835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 02:22:16.418671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41588 (local address 127.26.189.190:35125)
0806 02:22:16.418947 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0806 02:22:16.418951 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 02:22:16.419070 (+ 119us) server_negotiation.cc:407] Connection header received
0806 02:22:16.419307 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 02:22:16.419311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 02:22:16.419489 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 02:22:16.419610 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 02:22:16.419965 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:16.420800 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:16.422079 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 02:22:16.422418 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 02:22:16.422538 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 02:22:16.422959 (+ 421us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 02:22:16.423366 (+ 407us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 02:22:16.423467 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 02:22:16.423643 (+ 176us) server_negotiation.cc:299] Negotiation successful
0806 02:22:16.423717 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":123,"threads_started":1}
I20260806 02:22:16.427269 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 26345
I20260806 02:22:16.442188 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 26447
I20260806 02:22:16.455372 27382 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiSG4m/build/debug/bin/kudu with pid 26546
2026-08-06T02:22:16Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3326 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6643 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (301543 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST